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ABSTRACT 

This paper describes test development efforts for 
measuring achievement of selected concepts in social studies. It 
includes descriptive item and test statistics for the tests 
developed. Twelve items were developed for each of 30 concepts. 
Subject specialists categorized the concepts into three major areas: 
Geographic Region^ Man and Society^ and Map and Globe Study. The 
items were administered during early summer of 1970 to 196 girls who 
had just completed the fifth grade and during the fall of 1970 to 195 
boys who had just begun the sixth grade. Some of the major 
conclusions are: 1) reliability estimates obtained for both total 
concept scores and total task scores are sufficiently high to warrant 
study of the dimensionality of these social studies concepts and the 
dimensionality of the tasks when using social studies content; 2) the 
three area distinctions seem not to be important ones; 3) the 
difficulty item indices obtained indicate that these items are of 
appropriate difficulty levels for these subjects; and 4) almost all 
the items have desirable levels of discrimination indices when the 
item is both a part of a concept criterion score and a task criterion 
score. Related reports from the Project are ED 065 894 and ED 068 
410. (FDI) 
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Statement of Focus 



The Wisconsin Research and Development Center for Cognitive Learning 
focuses on contributing to a better understanding of cognitive learning by chil- 
dren and youth and to the improvement of related educational practices. The 
strategy for research and development is comprehensive. It includes basic re- 
search to generate new knowledge about the conditions and processes of learn- 
ing and about the processes of instruction, and the subsequent development of 
research-based instructional materials, many of which are designed for use by 
teachers and others for use by students. These materials are tested and refined 
in school settings. Throughout these operations behavioral scientists, curricu- 
lum experts, academic scholars, and school people interact, insuring that the 
results of Center activities are-based soundly on knowledge of subject matter 
and cognitive learning and that they are applied to the improvement of educa- 
tional practice. 

This Technical Report is from the Quality Verification Program and from the 
Project on the Structure of Concept Attainment Abilities in Program 1. The Qual- 
ity Verification program assisted in developing tests to measure concept achieve 
ment and identifying reference tests for cognitive abilities, while the Concept 
Attainment staff took primary initiative ia identifying basic concepts in social 
studies at intermediate grade level. The tests will be used to study the rela- 
tionships among cognitive abilities and learned concepts in various subject 
matter areas. The outcome of the Project will be a formulation of a model of 
structure of abilities in concept attainment in a number of subjects, including 
mathematics, science, and language an.s, as well as social studies. 
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Abstract 



Test development efforts for constructing 12 items to measure achievement 
of each of 3 0 selected social studies concepts are described. Item and total 
score statistics for data collected on 196 girls who had just completed the fifth 
grade and 195 boys who had just begun the sixth grade are presented and dis- 
cussed. 
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Introduction 



The primary objective of the project en- 
titled "A Structure of Concept Attainment 
Abilities" (hereafter referred to as the CAA 
Project) is to formulate one or more models 
or structures of concept attainment abilities, 
and to assess their consistency with actual 
data. The major steps for attaining this pri- 
mary objective were taken to be: 

1. To identify basic concepts in lan- 
guage arts, mathematics, science, 
and social studies appropriate at the 
fourth grade level, 

2, To develop tests to measure achieve- 
ment of these concepts, 

3. To identify reference tests for cog- 
nitive abilities, and 

4, To study the relationships among 
learned concepts in these four sub- 
ject matter fields and the identified 
cognitive abilities. 

This paper describes the test development 
efforts for measuring achievement of selected 
concepts in social studies; thus, it is a report 
of one aspect of Step 2. As such, it will in- 
clude descriptive item and test statistics for 
the tests developed. The items can be found 
in "Items to Test Level of Attainment of Social 
Studies Concepts by Intermediate Grade Chil- 
dren" (Tabachnick, Weible, & Livermore, 
1970). 

Concepts "may be defined in one or more 
of four ways: (a) structurally, in terms of 
perceptible or readily specifiable properties 
or attributes; (b) semantically, in terms of 
synonyms or antonyms; (c) operationally, in 
terms of the procedures employed to distin- 
guish the concept from other concepts; or 
(d) axiomatically, in terms of logical or nu- 
merical relationships (Klausmeier, Harris, 
Davis, Schwenn, & Frayer, 1968). "A concept 
exists whenever two or more distinguishable 



objects or events have been grouped or classi- 
fied together and sat apart from objects on the 
basis of some common feature or property of 
each" (Bourne, 1966, p. 1). The concept of 
Bourne's definition might be called a classi- 
ficatory one and seems to be the same as the 
structural type discussed by Klausmeier et al. 
(1968). This is the type of concept with which 
this project is concerned, and such a defini- 
tion of a concept served as the basis for selec- 
tion and analysis of subject matter concepts. 

Many different types of performance might 
be taken as the critical evidence that a stu- 
dent does or does not understand a given con- 
cept. Thus, as a part of this project it is 
necessary to have a schema for measuring 
understanding of concepts. Such a schema 
was developed by Frayer, Fredrick, and Klaus- 
meier (1969) and was used by the CAA Project 
to assess concept attainment. The "Schema 
-to^Testing the Level of Concept Mastery" con- 
sisbs^f 13 types of questions, each involving 
a different task required of the examinee. The 
schema\also allows for selection of an answer 
(multiple-choice type questions) or for produc- 
tion of an answer (completion type questions). 
It was decided to use the first 12 tasks and 
a multiple-choice format for this project. 
The 12 tasks of the schema which were used 
are: 

1. Given the name of an attribute, 
select an example of the attribute. 

2. Given an example of an attribute, 
select the name of the attribute. 

3. Given the name of a concept, select 
an example of the concept. 

4. Given the name of a concept, select 
a nonexample of the concept. 

5. Given an example of a concept, 
select the name of the concept. 

6. Given the name of a concept, select 
the relevant attribute. 
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Table 1. Social Studies Concepts Categorized by Area 



Geographic Region 



Man and Society 



Map and Globe Study 



Bay 

Canal 

Climate 
'^Coastline 
"^Delta 
^Desert 

Elevation 

Geography 
'^Gulf ^ 

Harbor ' 

Highland 

Hills 

Island 

Isthmus 

Lake 

LocGtion 

Mountain 

Mountain Pass 

Mountain Peak 
*Mountcin Region 

Ocean Currents 

Ocean Tides 

Peninsula 

Plain 

Prairie 

Precipitation 

Region 

Ridge 
*River 

*River Mouth 

River Source 
*Strait 

Subtropical Region 

Swamp 

Temperature 

Topography 

Transitional Region 
''^Tributary 
'"Tropical Region 

Valley 

Waterway 

Weather 



Agriculture 
'^Airway 

Basic Needs 
"City 

Commerce (trade) 
'^'Countryside 
"Democracy 

Economy 

Educational Institution 
'"Exchange 

Family 

Farming 

Fishing 

Forestry 
'''Government 

Industry 

Institutions 

International 
'''Land Routes 

Man 

Man as a member of a 
group 

Man as an individual 
Manufacturing 
Market 
Nation 
Nature 
*News 

'^Organization 
President 
Republic 

Service Organization 
Society 
State 
Suburban 
Transportation 
Urban 
Village 
'•'Waterway 



Area (square miles) 
Axis 

Boundary 

Continent 
'•'C ountry 

Day 
'■'Distance 

Earth 

'•'East-West (lines of 
latitude ) 

Equator 
"Globe 

Gravity 

Hemispheres 

Legend 

Map 

'"'Map Directions 
'•'Map Measurement 
'•'Map Scale 

Meridians 

Model 

Night 

'"'North- South (lines of 
longitude) 

Ocean 

Orientation 

Parallels • 
'■'Physical Feature Map 

Planet 

Political Map (of nations, 

countries ) 
Revolution 
Rotation 

Sea Level-Below Sea Level 
Seasons 
Solar System 
"''Symbol Map 
Topographical Map (map 
of land forms) 



'Concepts randomly selected to be tested. 
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7. Given" the name of a concept, select 
the irrelevant attribute. 

8. Given the definition of a concept, 
select the name of the concept. 

9. Given the name of a concept, select 
the definition of the concept. 

10. Given the name of a concept, select 
the supraordinate concept. 

11. Given the name of a concept, select 
the subordinate concept. 

12. Given the name of two concepts, 
select the relationship between them. 

Single- or compound-word classificatory 
concepts {those that are defined by attributes) 
in social studies subject matter at the fourth 
grade level were identified. This task was 
subdivided into four steps: 

1. Identification of the major areas 
within the subject matter of social 
studies, 

2. Selection of three of these major 
areas to be studied. 

3. Identification of classificatory con- 
cepts within each of these^ three 
major areas, and 

4. Random sampling of ten concepts 
from those identified for each of the 
three major selected areas. 

This yielded a total of 30 social studies con- 
cepts to be studied by the project.. A list is 
given in Table 1, by area, of the concepts 
identified and randomly selected for study. 
The areas are Geographic Region, Man and 
Society, and Map and Globe Study. A de- 
scription of the procedures us'ed to identify 
these concepts can be found in "Selection 
and Analysis of Social Studies Concepts for 
Inclusion in Tests of Concept Attainment" 
{Tabachnick, Weible, & Frayer, 1970). 

The researchers of Project 101, Situa- 
tional Variables and Efficiency of Concept 



Learning, developed a system for analyzing 
a concept in preparation for developing items 
to measure the level of attainment of that 
concept (Frayer, Fredrick, Klausmeier. l^f<9). 
Since the publication of that paper they, in 
cooperation with the researchers of the CAA 
Project, have refined their thinking and ad- 
vanced this system. The refinements are 
discussed in "A Structure of Concept Attain- 
ment Abilities: The Problem and Strategies 
for Attacking It" {Harris. Harris, Frayer. J. 
Quilling, in press). Briefly, a concept may 
be described in many ways: in terms of its 
criterial, relevant, and irrelevant attributes; 
its examples and nonexamples; its supra- 
ordinate, coordinate, and subordinate hierar- 
chical relationships (theoretically determined); 
and its lawful or other types of relationships 
to other concepts. Knowledge of each of these 
kinds of information may be tested to deter- 
mine a student's level of attainment of a con- 
cept. An analysis, along these lines, of each 
of the 30 sampled social studies concepts 
which are being studied can be found in 
"Selection and Analysis of Social Studies 
Concepts for Inclusion in Tests of Concept 
Attainment" {Tabachnick, Weible, & Frayer, 
1970). 

Thus, using the analysis of a concept 
as the basis for appropriate content and the 
12 tasks of the schema as the basis for ap- 
propriate tasks, 12 items were developed for 
each of the 30 concepts. There was one item 
for each of the 12 tasks {except for Concept, 
10 which had no Task 11), making a total of 
3 59 social studies items which were devel- 
oped for the purpose of measuring and assess- 
ing concept attainment in social studies. The * 
development of the items, along with item and 
total score statistics (for concepts and for 
tasks) obtained for them for fifth grade boys 
and girls, will be discussed in the following 
sections. 
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Procedures 



This section contains a discussion of the 
item development procedures used including 
initial item construction and revision of those 
items based on item analysis results. Also 
included is a discussion of the data collection 
procedures, subjects, and treatment o£ the data 

Test Development 

One item for each of the 12 tasks was 
generated for each of the 30 selected con- 
cepts, with the exception of Concept 10, 
Task 11. If one looks at the tasks used to 
measure understanding of the concept, it is 
apparent that there can be more than one item 
generated for at least some of the tasks. For 
example, a Task 1 type item could be con- 
structed to measure understanding of each of 
many relevant attributes for most concepts. 
For this project, -it was decided to construct 
just one multiple-choice item for each task 
for each concept. This made it necessary to 
have bases for making choices when such 
choices were necessary. These bases con- 
sisted of principles for selecting'attributes , 
relationships, incorrect choices, etc. A dis- 
cussion of such bases may be found in "A 
Structure of Concept Attainment Abilities: The 
Problem and Strategies for Attacking It" (Harris 
et g1., in press). 

General procedures for item ccjjaffitruction 
included initial item generation by a subject 
matter specialist item writer; critique of the 
items by a committee composed of the item 
writers from each of the four subject matters 
being studied (the other three are language 
arts, mathematics, and science), an experi- 
enced elementary school teacher specializing 
in reading, and a measurement specialist; and 
final critique by the subject matter principal 
investigator and a measurement specialist. 
Concerns in the item construction process 
were readability, validity, and reliability. 



Readability 

It was intended that no student should be 
unable to answer an item correctly simply be- 
cause of inability to read the item. In writing 
items, very simple language was used wherever 
possible. Several pilot .studies concerned with 
the readability question were conducted, and 
two outside consultants expert in the testing 
and measurement fields were asked to look at 
a sample of the items from the point of view 
of readability for fifth graders. No significant 
differences were found among treatment groups; 
percentage of occurrence of subjects who 
could not pronounce the word and did not know 
its meaning when shown the concept labels., 
but* did know its meaning when the word was 
pronounced, was judged to be negligible; and 
the two outside consultants independently ad- ' 
vised that there was no reading problem with 
the items and that there should be no concern 
about administering them in the standcird way 
in which the students read the items them- 
selves. The conclusion drawn from the results 
of the pilot studies and%the consultants' opin- 
ions was that readability of the items was not 
a problem and standard administration condi- 
tions would be' satisfactory. For further in- 
formation see Harris et al. (in press). 

Validity 

The content validity of each of the items 
was of immediate concern during item construc- 
tion; aspects of construct validity were to be 
probed later using duplicate test construction, 
simplex analysis, and factor analysis of the 
results obtained using the content-valid items 
constructed. 

Content Validity, Each item vvas con- 
structed to meet the content and task specifi- 
cations set for it. The task required of the 
student by each item was specified by the 
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schema adopted for use in measuring concept 
attainment. The concept name was given by 
the sampling process; the attributes, examples, 
definition, and iblationships associated with 
the concept name were defined by the prior 
analysis of the concept. The content for each 
item was specified in this manner. The con- 
tent specifications were not as precise as the 
task specifications due to the necessity of 
choosing a single attribute to be tested for 
example and selecting the incorrect, alterna- 
tives to be used in the multipl(2-choice 
questions. Systematic construction of alter- 
nate choices was used whenever possible; 
for example, for an item dealing with a path 
of.travel, other types of travel (or examples of 
them) were used as incorrect choices, e.g. 
airway, waterway, land route. 

To further ensure the content validity of 
the items, two persons who were familiar with 
the schema for testing concept attainment, but 
were not involved in the it^m development 
process, classifjod five random sets of 72 
items (12 items for six concepts in each set), 
according to content and task. These two 



persons had the analysis of the concepts 
available. They were able to correctly clas- 
o'ify all but a few of the items. Any questions 
they had about these few items were mutually 
resolved among the subject matter principal 
investigator, the measurement specialist, and 
themselves . 



Reliability 

Developing one item for each of the 12 
tasks for each of the 30 selected concepts 
yields a 12 (tasks) by ^0 (concepts) matrix 
consisting of the score for each of the 360 
items, one for each cell of the matrix, for 
each individual to whom the items are admin- 
istered. Thus, a completely crossed design 
exists and two types of total scores can be 
secured from this matrix: a total score for 
each of the 30 concepts (totalled across 
tasks) and a total score for each of the 12 
tasks (totalled across concepts). Figure 1 
is an illustration of such a matrix. 



Area 1 



10 



CONCEPTS 
Area 2 

1112 20 



Area 3 

21 22 30 



Total 
Score 
for Tasks 



TASKS 



12 



Total Score 
for 

Concepts 



Fig. 1. Item matrix for each individual. 
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This design offers these alternatives: 
(a) use a total scoro of 36O items to analyse 
all items again^* Val scores, 

each for on-' sting of 12 

items, to a -?ms against; 

and (c) US'. r-o- each for one task 

and consist iivj , ■ < nuins, to analyze the 
30 concept items against. The first alterna- 
tive was rejected since it assumes neither 
task nor concept variation is present. A 
choice was not made between the next two 
alternatives. Instead, both were done. An 
imporlfent theoretical problem of how to item 
analyze a completely crossed design like this 
remaip^j to be solved. 

Major concerns about reliability for the 
test development process were that internal 
consistency reliability estimates for task 
scores (total of 30 items across concepts) 
and concept scores (total of 12 items across 
tasks) be high enough to warrant further study 
using such scores. It was recognized that 
there might be sc^ije contradictions in what 
was attempted. The items were constructed 
to comply with the completely crossed design," 
30 concepts by 12 tasks. One major objective 
of the entire project is to determine the di- 
mensionality of the selected social studies 
concepts and of the tasks when using social 
studies content. If either or both of these are 
not unidimensional, then an internal consistency 
reliability estimate based upon items measur- 
ing aspects from the multidimensions would 
reflect this;'the more dimensions present and 
the more uncorrelated they are, the lower the 
internal consistency estimate. Recognizing 
this, and not being able to study the dimen- 
sionality of the two modes (concepts and 
tasks) until after the items were developed, 
pilot studies were conducted using the items 
for some of the concepts for the 12 tasks. As 
will be pointed out later, evidence indicates 
that sufficiently reliable scores can be ob- 
tained for both task scores and concept scores. 

I 

Item Revision 

If one looks at the 12 tasks for a single 
concept it becomes quite apparent that there 
may be a strong learning effect as one at- 
tempts to answer the items. The name of the 
concept appears in every item, except for the 
first two which deal with an attribute of the 
concept, either in the stem or as a possible 
choice. This makes a random presentation of 
the items desirable. Using items for six of 
the mathematics concepts presented on mark 
sense type cards, a study was conducted in 



v/hich one group of subjects responded to the 
items arranged in the same random order (over 
72 items for the six concepts) common to all 
subjects. The f^econd group of subjects re- 
sponded to the items arranged in a random 
order (over items for the six concepts) 
which was a unique one for each subject of 
the group. No significant differences in test 
scores were found between the subjects re- 
ceiving a common random order and those re- 
ceiving a unique random order. 

Tryouts of the items for item analysis 
and revision purposes were conducted using 
a single ran'^lom order over the items for six 
concepts contained in a test booklet. This 
constituted a "test"! of 72 items which could 
readily be administered in 1 hour. The tryouts 
were conducted during October, 1969, and 
January, 1970, with fifth grade students in the 
Madison, West Allis, and Sussex, Wisconsin 
school systems. Approximately 100 students 
(fewer for the Madison sample) respondt^d to 
each "test." Madison students were given 
the items for six of the concepts in October; 
West Allis and Sussex students responded to* 
the items for 12 concepts each in Jajiuary. 

The tryout data were subjected -co the 
Generalized Item Analysis Program (GITAP) 
(Baker, 1969), the output of which provides 
the proportion responding, item-criterion bi- 
. serial correlation, X50 (point on the criterion 
scale corresponding to the median of the item 
characteristic curve), and p (the reciprocal of 
the standard deviation of the item characteristic 
curve which is a measure of the discriminating 
power of the item) for each possible choice for 
each item as well as summary descriptive sta- 
tistics for the total test. It also gives t^e 
Hoyt reliability for the total test and the , 
standard error of measurement. 

As discussed earlier, the design for these 
social studies achievement items is one in 
which the concepts and tasks are completely 
crossed. Since there are no item analysis pro- 
cedures available for completely crossed de- 
signs, the data were analyzed in each of the 
two possible ways — each item as part of the 
appropriate concept score and as part of the 
appropriate task score. This raises questions 
as to the interpretation of such results. The 
main referents used for interpreting the re- 
sults and as a basis for making item revisions 
were the results obtained from the analyses 
of the concept scores. The tasks were fixed 
and thus any arbitrary decisions were made in 
regard to appropriate content for incorrect 
choices, etc. Usual standards for item ip- 
dices were not strictly adhered to, as a unique 
design for item analysis was being .used and 
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a major objective of the project is to study 
the dimensionality of the concepts and of the 
tasks. If high discrimination indices werc5 
demq^nded, the dimensionality might have been 
affG'jjted by making the items more homogeneous. 
Also, no attempt was made ' anipulate the 
difficulty level of the items, mce another ob- 
jective of the project is f<> <]- termine if any 
differential levels of difficulty, or complexity, 
exist in the concepts and in the tasks. There- 
fore, the item analysis results were used as a 
very general guide to help in determining 
whether there were "hidden" weaknesses, 
clues, and/or incongruities in the items and, 
in an even more general sense, to show that 
what we were attempting to do was possible — 
sufficiently reliable concept and task scores 
cpuld be obtained when using this completely 
crossed design. 

The revised items can be found in "Items 
to Test Level of Attainment of Social Studies 
Concepts by Intermediate Grade Children" 
{Tabachnick, Weible, &t Livermore, 1970). 

Subjects 

Pilot studies revealed that the concepts 
selected were very difficult for fourth graders. 
Thus, the decision was made to test fifth 
grade students with the concepts identified 
from the fourth grade textbooks. The social 
studies items were administered to 196 girls 
who had just completed the fifth grade during 
early summer, 1970, and to 195 boys who were 
i^t beginning the sixth grade during the fall 
cx 31970 in the public school system of Madi- 
.rvEiT... Wisconsin. The students were randomly 
<:^if^::ted from the population of all such girls 
ar-*^^iTom the population of all such boys. The 
Maiixiison Public School System made available 
tixe information concerning the populations 
'and u:sed their computing facilities to desig- 
nate the random sample for the girls . 

Initially, a random sample of 3O0 girls 
was drawn. Letters were sent to the parents 
of these students explaining the purpose and 
details of the testing, and inviting their 
daughter to participate in the testing program. 
Ai.stamped and addressed postcard was en- 
closed which the parents were asked to com- 
plete and return indicating whether or not they 
were willing to allow their daughter to partici- 
pate. One hundred and two yes responses 
and 25 no responses were obtained from the 
cards returned. Those parents who had not 
returned the card by a specified date were 
phoned. An additional 46 yes and 61 7io re- 
sponses were obtained by phone. Since this 



total of yes responses did not give as many 
subjects as were desired, an additional sample 
of 150 girls was drawn at random. From this 
sample, 56 yes and 30 no responses were ob- . 
tained by card. Thus, of the total sample of 
450 students, 203 yes and 1 16 fio responses 
were received; seven students did not com- 
plete the testing, which resulted in a total of 
196 girls tested. These students were paid 
$7.50 for participating. 

A random sample of 7 56 boys was drawn 
and letters were sent. By mail, 420 yes and 
87 no responses were obtained. Thirty-eight 
of the subjects did not complete the testing, 
resulting in 382 boys tested. Of this total, 
195 boys completed the mathematics and so- 
cial studies items; the others responded to 
language arts and" science items. As with the 
girls, the boys who completed the testing pro- 
gram were paid $7.50. 

Since the participation of all students 
comprising the random sample was impossible 
to attain, test score and IQ data were obtained 
for both the school population and those par- 
ticipating students from the files of the Madi- 
son Public School System for whom the infor- 
mation was available. Table 2 includes the 
summary statiPt|Lcs for the population of fifth 
grade students in the public school system of 
the city of Madison during the school year of 
1969-70, and for the boys and the girls wfeo 
comprised tiae tested samples foirthe soci^Jl 
studies iJeams. The Lorge-Thorndike InteJui- 
gence scanes were obtained in the fell of. 1968 
when the snbjects were fourth gradier.s, and 
the scores :on the Iowa Tests of Bsaic Skills, 
given in grade equivalent scores, were ob~ 
tained in the fall of 1969 when the subjects 
were fifth graders. 

Data were collected from the students/ 
using the Master Occupational Code of tl^e 
United States Bureau of the Census. These 
data were tabulated and are presented in 
Table 3. 



Data Collection 

The data for the girls were collected in 
two centrally located schools, one on the 
East side and one on the West side of the 
city, during five 2-hour daily sessions for one 
week. Subjects could choose the week and 
the school in which they wanted to report for 
testing. A one-week session was held at 
Hawtljiorne School from June 22 to June 26, 
and a one-week session was held at Hoyt 
School from July 13 to July 17. Each 2-hour 
session consisted of a 72-item "test" corn- 
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Table 2. Test Data for Populatic^ and Samples 



Test 



Population 



Boys 



Girls 



Lorge-Thorndike Intelligence 



Iowa Basic Skills 
Vocabulary 



Reading Comprehension 



Language Skills 



Work-Study Skills . 



Arithmetic Skills 



Composite 



X 
s 
N 

X 
s 
N 

X 
s 
N 

X 
s. 
N 

X 
s 
N 

X 
s 
N 

X 
s 
N 



106.60 
2605 

5.53 

2520 
5.44 

2520"^**" 
5.24 

2520 
5.46 

2520 
5.05 

2520 
5.3 5 

2520 



10 5.95 
14.74 

169 



181 



5.60 
1 .3^^ 

5.43 
I .60 

M 

5.07 
1 .43 



5.50 
I .31 

181 

5.08 
1 .04 

179 

5.34 
1.22 

179 



2.0Z 
Z.I 5 



191 



5.75 
I .34 

187 

5.84 
1 .46 

187 

5.74 
1.29 

187 

5.70 
1.13 

187 

5,24 
.97 

187 

5.65 
I.IO 

185 



posed of mat 



latics items, a 72-iteii:'**:test' 



composed of ir:::^cial studies items, and:3n ac- 
tivity break isiEiTwe en the two of approximately 
1/2 hour. The social studies and the mathe- 
matics items were given first on alternate days. 

The data for the boys were collected in a 
similar manner from mid-October to early No- 
vember. Ninety of the boys who were attend- 
ing Middle s'thool for sixth grade were tested 
after school for five consecutive days at 
Schenk (October 19-23), Sennett (October 26- 
30), and Orchard Ridge (November 2-6) schools; 
those 105 elementary school boys who com- 
pleted the testing were tested on three con- 
secutive Saturday mornings (October 10, 17, 
and 24) at Franklin, Longfellow, and Randall 
schools , 

The social studies items were arranged in 
four 72-item and one 71-item "tests." The 
order of the items was assigned randomly over 
the potential 360 items. Two different random 
orders were used to collect the data: one for 
each school for the girls and one for each type 
of school for the boys. 

The items were avranged in five test book- 
lets according to the random order. The stu- 



dents responded to the items by marking their 
chosen response directly on an answer sheet. 
The answer sheets were read by machine and 
the responses punched onto data cards. 'The 
tests were given by experienced test admin- 
istrators. 



Treatment of the Data 



The treatment of the data consisted of 
two main procedures: reliability estimation 
and item analysis. The data were aaolyzed 
separately for each sex group. Hoyi analysis 
of variance reliability estimate? were obtained 
for each of the 30 concept score ^ ond each or 
the 12 task scores for each group studied. 
Means and standard deviailions for each of the 
scores were also computed. 

Item- analyses using the GITAP program 
(Baker, 196?) were obtained for each of the 
items as a part of two different scores: an 
appropriate concept score and an appropriate 
task score. This program provides proportion 
responding, item-criterion:biserial correlation, 
X50. and p statistics for each choice of each 
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Table 3. Distribution of Fathers' Occupations 



Occupation 



Boys 



Girls 



j PROFESSIONAL, TECHNICAL, AND KINDRED WORKERS 

00. Accountant 

01. Architect 

02. Dentist 

03. Engineer 

04. Lawyer, Judge 

05. Clergyman 

06. Doctor 

07. Nurse 

08. ieacher. Professor 

09. Other Professional 

FARMER 

11. Farmer 

M&MAGERS, OFFICIALS, PROPRIETORS, EXCEPT FARM 

21. Owner of Business 

22. Manager, Official 

CLERICAL AND KINDRED WORKERS 
3 1 . Boolckeeper 
32. Receptionist 

39. Other Clerical and Kindr-^d Workers 

SALES WORKERS 
49, .Si^sman 

CRM^HSm^, FOREMEN, AND KIND:- 

51. Craftsman, Skilled Worlcvr 

52. Tcnsman 

53. Arnred- Services — Officer 

54. < Armed Services — Enlisted :K" 

OPERATIVES AND KINDRED WORKER (SEMI-SKILLED WORKERS) 

61. Truck. Driver 

62. Operative in Factory 

69. Other Operative and Kindred Workers 

PRIVATE HOUSEHOLD AND SERVICE WORKERS 

71. Fireman 

72. Policeinan 

73. Other Protective Service W^Orker 

74. Piractical Nurse., Nurse's Aide 

75. Ffrivate Household Workeirs 
79. CItfiier Service Workers 

81. :fcn-Farm Laborer 

82. Farm. Laborer 



' WORKERS (SKILLED WORKERS) 



2 
1 

5 
4 



18 
16 



2 
12 



91. Nbt presently in labor force 
99. Not ascertained 



20 

31 
2 
1 
1 

10 
9 

18 

1 
1 

2 
1 

14 



4 
13 



3 

4 

21 
22 



11 



15 

17 
4 
1 



5 

S 
23 

3 
1 

13- 



8 

22 



I 

10 



item. The proportion of students who respond 
correctly to an item is an index of the diffi- 
culty level of that item. The greater the value 
of the difficulty index, the easier the item. 
The biserial correlation coefficient is an in- 
dex of the discriminating ability of the item 
choice. For these analyses the criterion abil- 
ity used was total concept or total task score, 
X50 is the point on the criterion scale, given 



in standard deviation units, corresponding to 
the median of the item characteristic curv^e. 
It is the point at which subjects with that 
score have a 50-50 chance of choosing that 
response. (3 is the reciprocal of the standard 
deviation of the item characteristic curve at 
the X50 point. It is an index of the discrimina- 
tion power of the item. 
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Results and Discussion 



The means, standard deviations, and Hoyt 
reliability estimates obtained for the data col- 
lected during summer and fall of 1970 using 
the revised items are presented, separately, 
for boys and girls, for total concept and total 
task scores. Also included in this section 
are a presentation and discussion of the item 
indices obtained for the correct rdioice of 
each item using both concept ar:d task cri- 
terion scores. 

Reliability Estimates and 
Test Statistics 

Table 4 contains the meani ^andard 
deviations, and Hoyt reliability ^^r^iSraates ob- 
tained for the data collected dunai&'^^mmer. 
and fall, 1970, using the reviser: :2':^:3is for 
total concept scores. Table 5 cmnr-nxns this 
information for total task scores;. - data 
were analyzed separately for t h^ L : boys 
and the 196 girls. i(n general, :tte ^'^"^cept 
scores consist of 12 items each;.5r • the task 
scores of 30 items each. Exce-prir: s to this 
are given in the footnotes. 

The mean scores for boys sie enerally 
lower than are the mean scores-fb* - girls. No 
conclusions can be drawn from , however, 
as the data for the girls were cjQitejted in 
early summer shortly after the school year of 
their fifth grade had ended and ,tiie;data for 
the boys were collected in the fell shortly 
after the school year of their siyrn- grade had 
begun. Thus, it cannot be detenmsDsd what, 
if any, of this difference is due:fe:a sex dif- 
ference and what is due to a time difference 
and possible forgetting factor, fcshould also 
be rioted that the scores for the concepts 
Physical Feature Map and Deltaii^s based 
on one more item for boys thanlJisy are for 
girls; Physical Feature Map andDelta have 
12 items each for boys and 11 items for girls* 



The scores for te^sks 4 and 7 are made up of ' 
30 items for boys but only 29 for girls. The 
standard deviatinns are generally bigger for 
boys than they are for gMs, 

The relidbiiinT estimates are comparable 
for boys and girls- The reliability estimates 
for the task scores are generally a few points 
higher for boys thsn they are for girls, and 
the estimates for j.ust over half of the con- 
cepts are slightly highe: for boys with the 
remaining ones being h'gher for the girls. 

The reliability estimates are sufficiently 
high to warrant study of. the dimenbiojaality 
of these selected social studies concepts and 
the tasks when using social studies content. 
This is a major objective of the CAA Project 
and is the main purpose for developing these 
items to measure -^jCCial studies concept at- 
tainment. 

As was mentioned earlier, the subject 
matter speciali;3ts categorized the identified 
social studies concepts into three mo.jor areas: 
Geographic Region, Man and Society, and Map 
and Globe Study. This was done on a theo- 
retical basis. The data could be, and were, 
analyzed by area for task scores. Instead of 
a single total task score consisting of the 
score for that task type item for each of the 
30 concepts, three different task .'scores were 
obtained for each of the 12 tasks, consisting 
of the scores for that task type item for each 
of the 10 concepts within a single area. The 
mean, standard deviation, and Hoyt reliability 
estimrite for each of these 36 scores, 3 areas 
by 12 tasks, were obtained. Table 6 contains 
the reliability estimates obtained for task 
scores by area and for the total across all 30 
of the concepts. Spearman-Brown estimates 
for tripled test lengths (some are given at 
.the bottom of Table 6 for comparison purposes) 
indicate that the area distinctions are not im- 
portant ones; the reliability estimates for the 
total task scores are about what v/ould be 
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Table 4. Means, Standard Deviations, and Reliability Estimates for 
Social Studies Concept Scores: Boys and Girls^ 



Concept 


Mean 


Standard Deviation 


Hoyt Reliability 
Boys Girls 


tjoys*^ 


Girls^ 


Boys 


Girls 


1 


(5,(1 


y ,dZ 


2.53 


2.34 




"7 r\ 
. f U 


2 


6 .93 


5.9 M 


2,71 


2.55 


.71 


.68 


3 


8.18 


9.16 


2.09 


1 .76 




.4 8 


' 4 


8 .49 


8.36 


2.28 


. 1 


.63 


.(> I 


5 


8.93 


9.99 


2.28 


i.97 


.65 


.65 


6 


8 .3 1 


9.01 


2.54 


2.30 


.69 


.70 


7 


6 .80 


6 ,74 


2.47 


2.55 


.62 


.66 


3^ 


7 .60 


7.95 


2.72 


2.55 


.71 


.70 




7 .80 


8.29 


2.86"^ 


2.60 


.75 


.70 


:W 


7.71 1 


7.85t 


2.55 


2.39 


.73 


.72 


11 


8.45 


? .43 


2.59 


2.2r 


.69 


.66 


12 


8.41 


-.42 


2.54 


1.88 


.70 


.53 


.113 


8.32 


-.97 


2,62 


1.95 


.72 


.65 




6.64 


7.46 


2.72 


2.72 


.67 


.70 


lis 


7.61- 


3.85 


2.73 


2.54 


.70 


.74 




6.93 


^.98 


2.91 


2.41 


.74 


.68 


17 


8.19 


S.97 


2.. 6 8 


2.36 


.73 


.69 


18 


7 .36 


8.40 


2.68 


2.14 


.71 


.61 


19 


8.33 


9.. 70 


2.71 


2.33 


.73 


.74 


20 


8 .29 


9-i4 


2.47 


2.29 


.67 


.70 


21 


6.82 


7J.04 


2.39 


2.27 


,59 


.59 


22 


8.07 


9.21 


2.57 


2.39 


.68 


.71 


9 ^ 


7.21 


8-.D2 


2.92 


. 2.90 


.74 


.76 


^4 


8.82 


9.73 


2.13 


1 .62 


.62 


.51 


25 


6.49 


7-2:0 


2.12 


2.09 


.48 


.56 


Z6 


6.20 


7.J;6 


2.43' 


2.23 


.57 


.54 


27 


6.77 


7:3:2 


2.44 


2.44 


.59 


.64 


28 


6.63 


X30 . 


2.37 


2.39 


.60 


.65 


29 


6.28 




2.80 


2.52 


.72 


.70 


3.0 


7.04 


8U6 


2.50 


2.13 


.65 


.60 



Scores consist of 12 itemsr^ch except those marked by t which have 11 items each. 
= 195 
=196 



Table 5. Means, Standard Deviations, and Reliability Estimates for 
Social Studies Task Scores: Boys and Girls^ 



Mean Standard Deviation Hoyt Reliability 



Number 


Doys^ 


Girls^ 


Boys 


Girls 


Boys 




1 


22 .54 


7A 




.4.2v 


.^4 




•y 
L 


... i . ,\] 




•J) .33 


4.46 


.83 


.80 


•J 


w.^ • 1 *x 




5 .4 1 


4 .43 


.84 


.81 


4 


22.32 


23.O3I 


4.76 


3.82 


.81 


.7 7 


5 


21.30 


22.54 


5.63 


5.15 


.85 


.84 


6 


16.55 


15.15 


5.90 


5.35 


.82 


.80 


7 


14.24 


14.63t 


5.60 


4.78 


.80 


.74 


8 


19.29 


22.14 


6.55 


5.67 


.88 


.86 


0 


18.61 


21.34 


6.44 


5.71 


.87 


.86 


10 


19.25 


21.90 


5.49 


5.26 


.82 


.84 


11 


17.04t 


18.29t 


4.99 


4.52 


.78 


.7 6 


12 


13.71 - 


15.58 


5.98 


5.69 


.83 


.82 



Scores consist of 30 items each except those marked by t which have 29 items each. 
N = L'95 
= 196 
Key for Tasks: 

1 Given name of attribute, select example. 

2 Given example of attribute, select name. 

3 Given name of concept, select example. 

4 Given name of concept, select nonexample. 

5 Given example of concept, select name. 

6 Given concept, select relevant attribute. 

7 Given concept, select irrelevant attribute. 

8 Given definition of concept, select name. 

9 Given name of concept, select definition. 

10 Given concept, select supraordinate concept. 

11 Given concept, select subordinate concept. 

12 Given two concept's, select relationship. 
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Table 6. 


Reliability Estii:::;!,: for Task Scores by A: 






Total for Girls 












Area 








— -; 

Ge ograp h ic 


Man and 


M an and 




Task 


Region^ 


oociecy 


Globe Study° 


i otai^ 


1 


C n 


• OD 


.37 


.81 






.30 


.62 


.80 






A J. 






A 
•* 




.60 


.53 




5 


,o3 


.63 


.68 


.84 


b 


.63 




.46 


.80 


i 


.60 


.54 


.36t 


.74 


8 


.67 


.63 


.70 


.86 


9 


.68 


.69 


.66 


.86 


10 


.64 


■.75 


.60 


.84 


il 


.53t 


.62 


.40 


.76t 


1-2 


.63 


-.58 


.56 


.81 



Scores consist of 10 items each except those marked by t 
which have 9 items each. 

^Scores consist of 30 items each except those marked by X 
which have 29 items each. 

For comparison, these are the Spearman-Brown estimates for 
tripled test length:: 

Orlginail Estimated 

.40 
.50 
.60 
.65 
.70 



.67 
.75 
.82 
.85 
.88 



expected from tripling the length of the test 
when the single area reliability estimates are 
of the magnitude that were obtained. Also, 
preliminary factor results indicate that the 
area distinctions are not important ones. The 
factor analyses of these data will be reported 
in a later paper. 

Item indices 

Table 7 acaetains the item indices ob- 
tained, separately for boys and girls', bas:ed 
on both concsfrt: and task criterion scores.. 
The indices indnaded are proportion correct 
(this frequentl^r is caMed difficulty or P), item- 
criterion biserfel correiation, Xsot'and p. ISiey 
aiB given for tfe correct choice only. Xher^^key 
for the concepls:is given 'in Appendix. A rami 
the key ferthe.isasJcs is given in Table 5. ^e 
itenn, number has no special meaning; it is a 



coding number and was included in the table 
as an organizational aid. Note that proportion 
correct is the same whether analyzed using 
the concept criterion score or the task criterion 
score; hence, there is only one column each 
for boys and girls. The other item indices 
differ according to criterion score used. When 

item was missing from the data collected, 
the appropriate row was left blank except for 
the identifying numbers. This is the case for 
Item 119 for Concept 10, Task 11. Two items, 
"Nos. 16 and 343, were missing from the data 
coiltected for the girls but were available for 
the boys; in +his case only the columns for 
the' girls are blank. There are a few instances 
where there is a blank in an X50 column. If (3 
is very low, the X50 becomes meaningless; 
thus, X50 is not included if the p value is less 
than .0 5. There are two items, Nos. 52 -and 
145, for which the X50 and p columns for girls' 
coocept scores are blank. The biserial 
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Table 7. Item Indices Based on Concept and Task Criterion Scores 



Con- 



0) 

a 



CO 

s 

O 



0) 

Q 



V. 

(0 
0) 
P 



13 



Proportion 



Biserial 
Correlation 



Beta 



i'ask 


Item 


Correct 


Bo 


vs^ 
T 


Girls^ 
C T 


Boys 


Girls 


Boys 


Girls 


Boys 


Girls 


c 


c 


T 


c. 


T 

1, 


c 


J. 




T 


1 


1 


.83 


.77 


.60 


.38 


.71 


.52 


-.1.60 


-2.47 


-1.04 


-1.43 


.74 


.42 


1.01 


.61 


2 


2 


.81 


.85 


.56 


.62 


.54 


.54 


■■:l..-4 


-1.42 


-1.93 


-1.93 


.69 


.79 


.64 


.65 


3 


3 


.90 


.96 


.64 


.70 


.71 


.71 




_ 1 QA 

1 . o*t 


- 7 


-.7 R 1 


. Oj 


Q 0 
• 7 7 


1 n n 




4 


4 


.95 


.97 


.55 


.67 


.23 


.2'^ 






— W 1 

O. i J 


- A "^R 
O . J o 


/'.A 


QQ 


9 1 


1 1 


5 


5 


.78 


.77 


. 82 


.67 


.77 


.7r 




- 1 1 A 


OA 


- .73 


1 1 c; 


o n 
. V U 


1 . 1 V 


1.18 


6 


6 


. 52 


. 57 


.71 


.58 


.63 


.5_: 


* . Vi i " 


- .11) 


9 O 

- *c.y 


- . 0 D 


l.Ul , 


"7 9 


. 81 


.59 


7 


7 


.65 


.69 


.7 5 


.67 


.72 


.f 




. J o 


- 7 n 




1 1 9 


QQ 


1 • U4 


7 C 


8 


8 


.68 


.65 


.67 


.57 


.77 


.M 




. o u 


- R 1 


A 1 


Qn 


7 n 


1 1 Q 
1 . 1 7 


QA 


9 


9 


.64 


.80 


.81 


.74 


.86 


.80 






- .77 


_ 1 n A 

— 1 . U u 


1 A 


1 no 

i . U 7 


1 . ob 


1 0 9 


10 


10 


.77 


.89 


.66 


.61 


.66 


.64 




- 1 7 7 


_ 1 QA 


-1 Q Q 
— 1 . i3 7 


Q7 




Q O 
. OO 


O A 

. o4 


1 1 


11 


68 


.72 


. "v 7 


.62 


.75 


.70 






_. 77 


R7 


. 7^ir 


Q n 
. oU 


1.14 


o o 
.77 


12 


l2 


.50 


. 57 


.64 


. 57 


.72 


.65 


. OJ 


n 1 




77 


QA 
. 04 


A Q 
. t)7 


1 .U J 


o n 
. o7 


1 


13 


.52 


.60 


.76 


.64 


.51 


.47 


- .06 


- .07 


- .48 


- .52 


1.16 


.83 


.60 


.53 


2 


14 


.69 


.73 


.55 


.55 


.58 


.37 


- .91 


- .91 


-1.06 


-1.66 


.67 


.66 


.71 


-.27 


3 


15 


77 




.58 


.52 


.71 


.52 




— 1 AH 


QQ 


1 9 9 


. ^ 1 


. ol 


1.00 


. bO 


4 


16 






























5 


17 


.64 


. 54 


.73 


.65 


.79 


..58 


47 


. D4 


— . i J 




i. U ( 


Q K 
. O D 


1 9 *? 




6 


18 


.70 


.63 


.66 


. 57 


.67 


.55 


Q 1 

o 1 


— Q7. 
. 7 J 


_. P. 1 


A 1 


Q7 
. 0 ( 


A Q 


. 9U 




7 


19 


.42 


.44 


. 7 


. 57 


.57 


.44 


J*t 




. ^ D 




7A 
. (4 


. ( U 


.70 


A O 

.49 


8 


20 


. 57 


.64 


.72 


.68 


.69 


.80 




. ^ 0 




A A 




Q 1 
. 7 J 


Q / 
. 7 b 


1.31 


9 


21 


.61 


.59 


.66 


.37 


.59 


.59 


— ,40 


— 7 7 




- • J 7 


QQ 
. 0 7 


•1 n 


. ^ J 




10 


22 


.57 


.42 


.62 


.39 


.77 


-.53 


— .30 


- 4R 


7 7 


• J 7 


79 


A 


1 9 n 


A 9 

. b ^ 


11 


23 


.14 


.18 


.38 


.30 


.20 


■ .13. 


7 VJ 


J . u u 


J. A7 


7 1 ^ 


An 


1 


9 n 


1 1 


12 


24 


.48 


.46 


.66 


.60 


.72 


.66 


09 


. 1 0 


1 A 


. 16 


. o o 


7 c; 


1 n 


Q R 
. OO 


1 


25 


.80 


.88 


.66 


.55 


.56 


.49 


—1.27 


-1.52 


-2.09 


-2.37 


.88 


.66 


.67 


.56 


2 


26 


.70 


.73 


.61 


.65 


• 67 


.66 


— .85 


- .79 


- .91 


- .93 


.76 


.86 


.91 


.87 


3 


27 


.80 


.90 


.63 


.44 


•41 


.22 


" v.. 3: 5 


- 1 9 

1 . 7 J 


— "^ nft 


A7 


Rn 


AR 
.^0 


A c; 

.43 


9 1. 


4 


28 


.96 


.97 


.41 


.51 


• 68 








- 7 R9 

— ^. 07 


- 7 n 


A A 


c;q 

. 37 


Q 9 
.7^ 


7 7 
. ( ( 


5 


29 


.91 


.97 


. 56 


.44 


.48 






-■^ 1 n 


—4 n7 


-7 n7 


AR 


AQ 
.47 


. DD 


9 Q 
.^7 


6 


30 


.4r8 


.64 


-. 53 


.48 


.60 


.34 




09 

. U 7 


- A 1 


- 1 n A 


A7 


c; c; 


7 A 


1 7 


7 


31 


.41 


.40 


. 5S 


.53 


.74 


.5€ 


,.:4il: 


4A 






7 1 


A7 


1 in 


c; 7 


8 


32 


.75 


.91 


.55 


.66 


.73 


.58 




— 1 n c; 


— 1 Q A 


- 7 7. A 


Ac; 

. OD 


R7 
. O r 


1 . U ( 


*? 1 
. f 1 


9 


33 


.67 


.84 


.77 


.74 


.72 


.67 


i;q 

.-JO 


. o u 


-1 A 


-1 A7 
i . 4 ( 


1 9 n 


1 19 


1 r\ A 
1 . U4 


Q n 
.90 


10 


34 


.77 


.86 


.60 


.48 


.60 


.66 




— 1 c; 7 


— 1 Q9 

— i . 


-1 Ac; 


7 c; 


c; c; 


*? c 
. f D 


o o 
. OO 


1 1 


35 


. 58 


.67 


.48 


.38 


.48 


.3.4 






— QA 
. 74 


— 1 9 


<; c; 


A 1 

.41 


. 55 


.JO 


12 


36 


.34 


.38 


.35 


.26 


.42 


Ji6 


' 1 ^ 


!• DO 


. r ^ 


1 . O J 


.Jo 


9 A 


.46 


. 1 7 


1 


37 


.93 


.94 


.70 


.66 


.64 


.67? 


—iZ. 08 


-7 7 1 




-7 R 


Q9 

.77 


R R 
. OO 


Q 7 
• O J 


Q n 

. 7 U 


2 


38 


.89 


.94 


• 56 


.57 


.45 




-2.20 


-2.18 


-3.44 


-3.90 


.68 


.69 


.50 


.43 


3 


39 


.91 


.84 


.73 


.75 


.73 


•M 


-1.81 


-1.77 


-1.31 


-1.63 


1.07 


1.13 


1.18 


.78 


4 


40 


.89 


.93 


.57 


.62 


.65 


..65 


-2.11 


-1.96 


-2.33 


-2.32 


.70' 


.79 


.85 


.85 


5 


41 


.56 


.51 


.56 . 


•47 


.49 




- .29 


- ..34 


- .03 


- .03 


.67 


.53 


.58 


.47 


6 


42 


.60 


.67 


.61 


.52 


.63 


•52 


--..41 


- .49 


- .72 


- .86 


.78 


.61 


.80 


.62 


7 


43 


.58 


.64 


.54 


.54 


.67 


• 70 


- .37 


— .37 


- .52 


- .50 


.65 


.64 


.91 


.99 


8 


44 


.52 


.54 


.62 


.56 


.53 


.46 


- .07 


— .08 


- .19 


- .22 


.78 


.67 


.62 


.51 


9 


45 


.64 


.56 


.60 


.51 


.68 


-55 


- .60 


- -70 


- .23 


- .28 


.75 


.60 


.92 


.66 


10 


46 


.74 


.86 


,67 


.54 


.78 


.61 


- .98 


-1.22 


-1.40 


-1.78 


.90 


.64 


1.25 


.78 


11 


47 


.72 


.37 


•73 


.69 


..52 


AZ 


- .79 


- .83 


.65 


.80 


1.08 


.96 


.61 


.47 


12 


48 


.51 


.55 


• 59 


.54 


.66 


.49 


— •05 


- .06 


- .19 


- .26 


.73 


.65 


.89 


.56 
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Table 7 (continued) 



Biserial 

Proportion Correlation Xsc Beta 

Co^- Correct Bovs^ Girls^ Bovs Girls Bovs Gir^s 

cept Task Item Boys Girls CTCT C T C T C T C 1 



o 
c 



o 
2 



1 


49 


.78 


.84 


.41 


.38 


.56 


.50 


-1.94 


-2.05 


-1.74 


-1.98 


.45 


.42 


.68 




.57 


2 


50 


.78 


.87 


.63 


.67 


.84 


.67 


-1.23 


-1.16 


-1.32 


-1.66 


.81 


.89 


1.56 




.91 


3 


51 


.86 


.92 


.60 


.56 


.59 


.62 


-1.79 


-1.91 


-2.41 


-2.31 


.74 


.67 


.73 




.79 


4 


52 


.97 


.98 


.70 


.57 


L21 


.79 


-2. 73 


-3.42 




-2.59 


.98 


.69 




1 


.29 


5 


53 


.90 


.94 


.56 


.47 


.68 


.70 


-2.33 


-2.73 


-2.26 


-2.21 


.67 


.54 


,93 




.98 


6 


54 


.48 


.63 


.69 


.63 


.66 


.65 


.08 


.09 


- .51 


- .52 


.94 


.81 


,88 




.86 


7 


55 


.64 


.73 


.64 


.59 


.61 


.60 


- .57 


- .61 


-1.00 


-1.02 


.83 


.74 


,78 




.75 


8 


56 


.71 


.86 


.69 


.58 


.83 


.80 


- .80 


- .95 


-1.31 


-1.36 


.94 


.70 


1.50 


1 


.33 


9 


57 


.70 


.84 


.71 


.62 


.55 


.57 


- .75 


- .86 


-1.77 


-1.72 


1.02 


.79 


,66 




.70 


10 


58 


.77 


.89 


.73 


.64 


!85 


.84 


-1.03 


-1.18 


-1.42 


-1.45 


1.07 


.83 


1.63 


1 


.53 


11 


59 


.73 


.67 


.67 


.52 


.71 


.62 


- .94 


-1.21 


- .61 


- .70 


.89 


.60 


1,01 




.79 


12 


60 


.59 


.83 


.67 


.53 


.86 


.71 


- .36 


- .45 


-1.10 


-1.32 


,91 


,63 


1,65 


1 


.01 



> 



1 


61 


.67 


.79 


.73 


.77 


.72 


.70 


- .59 • 


- .56 


-1.10 


-1.14 


1.07 


1,21 


1,04 


.97 


2 


62 


.75 


.86 


.55 


.42. 


.78 


.70 


-1.23 


-1.62 


-1.39 


-1.55 


,67 


,47 


1,26 


.99 


3 


63 


.83 


.88 


.58 


.63 


.58 


.58 


-1.65 


-1.52 


-2.05 


-2.06 


,71 


.81, 


,71 


,70 


4 


64 


.84 


.95 


.50 


.41 


.47 


.39 


-1.96 


-2.36 


-3.71 


-4,52 


,58 


,45 


,53 


,42 


5 


65 


.84 


.87 


^ .64 


.55 


.78 


.54 


-1.56 


-1.80 


-1.42 


-2,05 


,83 


,67 


1,26 


,65 


6 


66 


.43 


.38 


.50 


.48 


.60 


.54 


.35 


.37 


.52 


.58 


.57 


.54 


,75 


.63 


7 


67 


.55 


.46 


.68 


.52 


.53 


.36 


- .20 


- .26 


,17 




.93 


,61 


,63 


.39 


8 


68 


.75 


.71 


.57 


.47 


.74 


.6V 


-1.16 


-1.43 


- ,77 


- ,88 


.71 


,53 


1.08 


.83 


9 


69 


.67 


.83 


.76 


.68 


.73 


.70 


- .56 


- .64 


-1.31 


-1.37 


1.18 


.92 


1.08 


.99 


10 


70 


.69 


.86 


.63 


.57 


.HTT84 


- .80 


- .88 


-1.31 


-1.30 


,80 


.70 


1.52 


1.54 


11 


71 


.78 


.78 


.74 


.67 


.88 


.76 


-1.00 


-1.15 


- .88 


-1.02 


1.10 


.91 


1.83 


1.17 


12 


72 


.51 


.67 


.73 


.72 


.72 


.60 


- .04 


- .04 


- .62 


- .75 


1,06 


1.03 


1,04 


.75 



3 
O 

U 

t 



1 


73 


.48 


.42 


.61 


.39 


.64 


.43 


.10 


.15 


.32 


.48 


.76 


,43 


,83 


.47 


2 


74 


.28 


.21 


.40 


.22 


.27 


.32 


1.44 


2.65 


2.98 


2,45 


,44 


,22 


,28 


.34 


3 


75 


.87 


.92 


.48 


.66 


.55 


.70 


-2.34 


-1.72 


-2,62 


-2.05 


.55 


.88 


.65 


.98 


4 


76 


.84 


.81 


.51 


.55 


.45 


.64 


-1.95 


-1.82 


-1.90 


-1.34 


.59 


,66 


.51 


.84 


5 


77 


.65 


.59 


.56 


.43 


.59 


.42 


- .69 


- .91 


- .40 


- .55 


.68 


.47 


.72 


.47 


6 


78 


.57 


.64 


.62 


.59 


.76 


.54 


- .28 


- .29 


- ,48 


- .68 


.79 


.73 


1.16 


.63 


7 


79 


.44 


.47 


.50 


.41 


.53 


.45 


.30 


.36 


.14 


.17 


.57 


.45 


.63 


.50 


8 


80 


.62 


.55 


-.65 


.35 


.78 


.53 


- .45 


- .85 


- .15 


- .22 


.85 


.37 


1.24 


.62 


9 


81 


.62 


.63 


.77 


.59 


.79 


.47 


- .38 


- .50 


- .41 


- .69 


1.23 


.73 


1.31 


.53 


10 


82 


.43 


.53 


.34 


.33 


.44 


.34 


.54 


.57 


- M5 


- ,19 


.37 


.35 


.49 


.36 


11 


83 


.52 


-.43 


.66 


.54 


.62 


.49 


- .09 


- .11 


.29 


,37 


,88 


.64 


.79 


.56 


12 


84 


.48 


.55 


.66 


.53 


.66 


.48 


.07 


.08 


- .19 


- .27 


,89 


.63 


.88 


.55 



CO 



1 


85 


.78 


.84 


.52 


.54 


.60 


.56 


-1.52 


-1.46 


-1.63 


-1,70 


.60 


.64 


.76 


.71 


2 


86 


.78 


.76 


.64 


.58 


.51 


.58 


-1.20 


-1.32 


-1.48 


-1.30 


.84 


.72 


.60 


.71 


3 


87 


.84 


.87 


.67 


.69 


.65 


.39 


-1.50 


-1.45 


-1.73 


-2.95 


.89 


.94 


,88 


.42 


4 


88 


.80 


.89 


.68 


.57 


.47 


.40 


-1.23 


-1.49 


-2.58 


-3.01 


.94 


.69 


.53 


.44 


5 


89 


.65 


.57 


.75 


.71 


.77 


.62 


- .50 


- .53 


- .22 


- .27 


1.14 


1.00 


1.22 


,80 


6 


90 


.59 


.59 


.43 


.35 


.52 


.54 


- .56 


- .69 


- .42 


- .40 


.48 


.37 


.61 


,65 


7 


91 


.45 


.49 


.64 


.60 


.54 


.47 


.21 


.23 


.05 


.05 


.84 


.75 


.65 


.53 


8 


92 


.67 


.67 


.81 


.57 


.74 


.42 


- .53 


- .75 


- .61 


-1.06 


1.40 


.70 


1.09 


,47 


9 


93 


.57 


.68 


.68 


.51 


.83 


.74 


- .26 


- .34 


- .56 


- .63 


.94 


.59 


1.46 


1.10 


10 


94 


.62 


.78 


.68 


.53 


.65 


.54 


- .45 


- .58 


-1.16 


-1.40 


.92 


.62 


.86 


,64 


11 


95 


.41 


.38 


.61 


.59 


.63 


.54 


.40 


.41 


.48 


.55 


.76 


.72 


.80 


.65 


12 


96 


.45 


.43 


.64 


.58 


.75 


.66 


.21 


.23 


.24 


.27 


.84 


.72 


1.12 


.87 
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Table 7 (continued) 



Propoition 
Correct 



Con- 
cept Task Item Boys Girls C T C 



Biserial 
Correlation 
Boys^ Girlsb 



Beta 



Bovs 



Girls 



Bovs 



Girls 



C 



ra 

JQ 



1 


97 


.87 


.86 


.40 


.51 


.53 


.46 


-2.83 


-2.24 


-2.00 


-2.32 


.44 


.59 




.63 


.52 


2 


93 


.52 


.66 


.33 


.26 


.40 


.38 


- .17 


- .23 


-1.06 


-1.10 


.35 


.27 




.44 


.42 


3 


99 


.75 


.77 


.68 


.59 


.66 


.54 


- .98 


-1.13 


-1.10 


-1.35 


.93 


.74 




.87 


.63 


4 


100 


.64 


.73 


.68 


.51 


.69 


.63 


- .51 


- .69 


- .89 


- .97 


.92 


.59 




.94 


.81 


5 


101 


.81 


.87 


.74 


.75 


.77 


.67 


-1.16 


-1.15 


-1.44 


-1.67 


1.11 


1.12 


1. 


.22 


.90 


6 


102 


.59 


.59 


.75 


.64 


.72 


.60 


- .32 


- .37 


- .30 


- .37 


1.15 


.84 


1. 


.05 


.74 


7 


103 


.53 


.58 


.66 


.63 


.55 


.57 


- .11 


- .11 


- .38 


- .36 


.88 


.80 




.65 


.69 


8 


104 


.67 


.67 


.74 


.68 


.70 


.50 


- .60 


- .65 


- .62 


- .87 


1.11 


.93 




.99 


.58 


9 


105 


.65 


.68 


.81 


.73 


.79 


.60 


- .46 


- .51 


- .59 


- .77 


1.41 


1.06 




,30 


.75 


10 


106 


.64 


.70 


.77 


.65 


.66 


.59 


- .47 


- .55 


- .81 


- .91 


1.19. 


. .86 




.89 


.74 


11 


107 


.65 


.71 


.79 


.67 


.77 


.62 


- .47 


- .56 


- .72 


- .88 


1.29 


.90 


1, 


.19 


.80 


12 


108 


.49 


.48 


.62 


.63 


.49 


.34 


.05 


.05 


.10 


.15 


.80 


.81 




.56 


.36 



10 



c 

o 

•iH 

D) 
(U 

o 

'3. 

o 



1 


109 


.84 


.85 


.77 


.73 


.52 


.45 


-1.30 


-1. 


.37 


-2.00 


-2.34 


1.21 


1.07 


.61 


.50 


2 


110 


.83 


.94 


.69 


.70 


.40 


.60 


-1.39 


-1. 


.36 


-3.94 


-2.63 


.95 


.99 


.44 


.76 


3 


111 


.76 


.81 


.76 


.68 


.87 


.79 


- .93 


-1. 


.03 


-1.01 


-1.12 


1,16 


,94 


1.78 


1.29 


4 


112 


.82 


.82 


.81 


.69 


.77 


.66 


-i.ll 


-L 


.30 


-1.17 


-1.37 


1.38 


.96 


1.20 


.88 


5 • 


113 


.71 


.75 


,84 


.79 


.83 


.79 


- .65 




.69 


- .91 


- .96 


1.54 


1.28 


1.49 


1.30 


6 


114 


.61 


.61 


.63 


.61 


.76 


.5? 


- .42 




.44 


- .37 


- .48 


.81 


.76 


1.17 


.74 


7 


115 


.49 


.37 


.44 


.35 


.53 


.39 


.04 




,06 . 


.64 


.88 


.49 


.37 


.63 


.42 


8 


116 


.72 


.79 


.65 


.68 


.80 


.79 


- .91 




.87 


-1.01 


-1.02 


.85 


.93 


1.34 


1.29 


9 


117 


.58 


.48 


.77 


.66 


.68 


.52 


- .26 




,31 


.06 


.07 


1.21 


.87 


.92 


.60 


10 


118 


.76 


.74 


.83 


.72 


.77 


.75 


- .84 




,99 


- .86 


- .88 


1.51 


1.03 


1.20 


1.12 


11 


119 
































12 


120 


.59 


.65 


.63 


.56 


.76 


.61 


- ,38 




.43 


- .50 


- .62 


.80 


.68 


1.16 


.77 



11 



1 


121 


.84 


.96 


.79 


.65 


.86 


.99 


-1 


.26 


-1.53 


-2.03 


-1.75 


1.29 


.86 


1.66 


.75 


2 


122 


.71 


.85 


.55 


.50 


.74 


.68 


-1 


.02 


-1.13 


-1.38 


-1.51 


.66 


.57 


1.11 


.92 


3 


123 


.62 


.68 


.53 


.53 


.65 


.66 




.58 


- .58 


- .71 


- .70 


.62 


.63 


.86 


■ .87 


4 


124 


.66 


.78 


.64 


.56 


.61 


.58 




.63 


- .72 


-1.24 


-1.31 


.83 


.67 


.77 


.71 


5 


125 


.73 


.67 


,69 


.64 


.71 


.67 




.91 


- .'98 


- .61 


- .65 


..95 


.83 


1.02 


.89 


6 


126 


.66 


.84 


.62 


.56 


.57 


.36 




.65 


- .72 


-1.76 


-2.76 


.78 


.68 


.69 


.39 


7 


127 


.64 


.64 


.59 


.58 


.52 


.42 




.61 


- .62 


- .68 


- .85 


.73 


.72 


.60 


.46 


8 


12« 


.80 


.88 


.71 


.67 


.80 


.82 


-1, 


.19 


-1.26 


-1.45 


-1.42 


1.00 


.90 


1.34 


1.42 


9 


129 


.73 


.79 


.73 


.62 


.79 


.63 




,83 


- .98 


-1.02 


-1.29 


1.07 


.79 


1.31 


.80 


10 


130 


.73 


.82 


.67 


.56 


.79 


.69 




.92 


-1.11 


-1.13 


-1.30 


.91 


.68 


1.32 


.97 


11 


131 


.75 


.89 


.53 


.37 


.55 


.58 




,27 


-1.79 


-2.25 


-2.14 


.62 


.40 


.66 


.71 


12 


132 


.57 


.65 


.67 


.55 


..63 


.50 




,28 


- .34 


- .60 


- .76 


.90 


-.66 


.81 


.57 



12 



1 


133 


.93 


.98 


.65 


.68 


.35 


.18 


-2.27 


-2.14 


-5.56 


-11.13 


.84 


.94 


.40 


.19 


2 


134 


.87 


.95 


.68 


.60 


.75 


.67 


-1.63 


-1.86 


-2.24 


-2.52 


.93 


.75 


1.15 


.90 


3 


135 


.74 


.92 


.84 


.83 


.70 


.51 


- .78 


- .79 


-2.00 


-2.71 


1.53 


1.49 


.97 


.60 


4 


136 


.79 


.87 


.69 


.53 


.77 


.68 


-1.16 


-1.51 


-1.47 


-1.66 


.96 


.63 


1.22 


.94 


5 


137 


.83 


.85 


.60 


.69 


.74 


.80 


-1.55 


-1.36 


-1.41 


-1.31 


.76 


.95 


1.10 


1.33 


6 


138 


.61 


.69 


.55 


.51 


.61 


.55 


- .49 


- .53 


- .81 


- .90 


,65 


.59 


.77 


.65 


7 


139 


.58 


.62 


.55 


.41 


.41 


.41 


- .36 


- .49 


- .77 


- .77 


.67 


.45 


.45 


.45 


8 


140 


.61 


.73 


.68 


.66 


.67 


.55 


- .41 


- .43 


- .91 


-1.11 


.93 


.87 


.91 


.66 


9 


141 


.55 


.64 


.68 


.66 


.61 


.56 


- .20 


- .21 


- .58 


- .63 


.93 


.87 


.76 


.68 


10 


142 


.66 


.78 


.74 


.56 


.72 


.66 


- .56 


- .75 


-1.05 


-l.lli 


1.10 


.67 


1.04 


.88 


11 


143, 


.74 


.82 


.49 


.38 


.47 


.41 


-1,.33 


-1.74 


-1.94 


-2.24 


.56 


.41 


.54 


.45 


12 


144 


.50 


.57 


.69 


.63 


.47 


.28 


.01 


.01 


- .36 


- .60 


'.96 


.81 


.53 


.29 
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Table 7 (continued) 



Proportion 

Con- Correct 

cept Task Item Boys Girls 



Biserial 
Correlation 
Bovsa Girlsb 
C T C T 



Beta 



Boys 



Girls 



Boys 



Girls 



C 



C 



13 



o 
to 

c 

3 
O 

O 



14 



o 
rO 

o 

O 



15 



0) 

c 

o 
w 



1 


145 


.72 


.87 


,82 


.75 


1.01 


.84 


- .72 




,79 




-1.35 


1.44 


1.14 




1.57 


2 


146 


.79 


.94 


.65 


.65 


.67 


.62 


-1.26 


-I. 


,27 


-2.39 


-2.54 




.86 


.85 


.89 


.80 


3 


147 


.89 


.96 


.68 


.68 


.62 


.50 


-1.81 


-1, 


,82 


-2.80 


-3.46 




.94 


.93 


.79 


.58 


4 


148 


.87 


.93 


.62 


.62 


.89 


.62 


-1.79 


-1.80 


-1.70 


-2.44 




.79 


.78 


' 1.93 


.78 


5 


149 


.89 


.94 


.62 


.49 


.73 


.61 


-1.99 


-2. 


,53 


-2.16 


-2.59 




.79 


.56 


1.08 


.77 


6 


150 


.62 


.74 


.69 


.54 


.71 


.60 


- .42 




,54 


- .93 


-1.09 




.96 


.64 


1.00 


.76 


7 


151 


.56 


.71 


.79 


.65 


.62 


.64 


- .19 




,23 


- .91 


- .89 


1 


.30 


.85 


' .79 


.83 


8 


152 


.64 


.86 


.55 


.49 


.31 


.12 


- .64 




,71 


-3.49 


-9.25 




.65 


.56 


.33 


.12 


9 


153 


.56 


.66 


.61 


.57 


.61 


.56 


- .26 




,28 


- .69 


- .75 




.78 


.69 


.77 


.67 


10 


154 


.42 


.63 


.68 


.57 


.77 


.62 


.29 




,35 


- .44 


- .54 




.94 


.70 


1.19 


.80 


11 


155 


.63 


.86 


.71 


.54 


.73 


.40 


- .47 




,62 


-1.50 


-2.74 


1 


.00 


.64 


1.07 


.43 


12 


156 


.73 


.84 


.64 


.49 


.92 


.66 


- .94 


-1.23 


-1.08 


-1.52 




.84 


.57 


2.41 


.88 


1 


157 


.56 


.73 


.65 


.60 


.66 


.71 


- .25 




27 


- .92 


- .86 




.86 


.76 


.89 


1.02 


2 


158 


.58 


.67 


.69 


.62 


.76 


.62 


- .29 




,32 


- .57 


- .71 




.94 


.78 


1.18 


.78 


3 


159 


.62 


.69 


.62 


..42 


.74 


.66 


- .49 




,74 


- .66 


- .75 




.80 


.46 


1.13 


.87 


4 


160 


.52 


.64 


.49 


.45 


.54 


.47 


- .12 




.13 


- .66 


- .75 




. 56 


.50 


.64 


.53 


5 


161 


.73 


.73 


.60 


.41 


.65 


.56 


-1.01 


-1. 


.47 


- .96 


-1.13 




.75 


.45 


.86 


.67 


6 


162 


.50 


.56 


.49 


.33 


.52 


.40 


.01 




02 


- .27 


- .35 




. 56 


.35 


.61 


.43 


7 


163 


.39 


.39 


.47 


.24 


.21 


.11 


.60 


1. 


15 


1.35 


2.56 




.53 


.25 


.22 


.11 


•8 


164 


.56 


.64 


.71 


.64 


.71 


.55 


- .23 




.25 


- .51 


- .67 


1 


.02 


.83 


1.02 


.66 


9 


165 


.55 


.69 


.65 


.62 


.74 


.63 


- .19 




.20 


- .66 


- .79 




,86 


.80 


1.11 


.80 


10 


166 


.77 


.84 


.57 


.57 


.85 


.76 


-1.32 


-1 


.32 


-1.18 


-1.31 




.70 


.69 


1.60 


1.18 


11 


167 


.43 


.45 


.68 


.56 


.63 


.59* 


.26 




.31 


.18 


.20 




.92 


.68 


.82 


.73 


12 


168 


.42 


.43 


.51 


.37 


.66 


.57 


.42 




.58 


.27 


.32 




.59 


.40 


.88 


.69 




169 


.58 


.79 


.71 


.64 


.67 


.68 


- .28 




.31 


-1.17 


-1.16 


1 


.02 


.83 


.91 


.93 




170 


.64 


.64 


.57 


.51 


.68 


.71 


- .63 




.71 


- .54 


- .51 




.69 


.59 


.93 


1.02 


3 


171 


.66 


.87 


.59 


.59 


.80 


.67 


- .69 




.68 


-1.42 


-1.70 




.72 


.73 


1.35 


.90 


4 


172 


.63 


.72 


.66 


.58 


.67 


.67 


- .48 




.56 


- .88 


- .89 




.88 


.71 


. .91 


.91 


.5 


173 


.56 


.64 


.69 


.53 


.72 


.57 


- .24 




.30 


- .49 


- .62 




.94 


.63i 


1.03 


.69 


6 


174 


.58 


.67 


.51 


.44 


.64 


.60 


- .39 




.45 


- .70 


- .75 




.59 


.49 1 


.83 


.75 


7 


175 


.56 


.62 


.43 


.50 


.74 


.62 


- .37 




.33 


- .40 


- .48 




.48 


.57 ' 


1.11 


.80 


8 


176 


.74 


.89 


.83 


.82 


.77 


.72 


- .77 




.78 


-1.58 


-1.69 


1.46 


1.42 


1.20 


1.03 


9 


177 


.71 


.88 


.63 


.65 


.93 


.87 


- .89 




.87 


-1.28 


-1.37 




.81 


.85 


2.44 


1.73 


10 


178 


.70 


.81 


.76 


.62 


.88 


.78 


- .68 




.84 


-1.00 


-1.13 


1 


.16 


.78 


1.87 


1.26 


11 


179 


.84 


.90 


.73 


.65 


.68 


.55 


-1.36 




,54 


-1.87 


-2:31 


1 


.08 


.86 


.92 


.66 


12 


180 


.41 


.42 


.51 


.44 


.54 


.48 


.45 




.52 


.38 


.43 




.59 


.49 


.64 


.54 



16 



c 

Q) 

e 

c 

u 

0) 
> 

o 
O 



1 


181 


.72 


.72 


.71 


.73 


.66 


.59 


- .84 


- .81 


- .90 


-1.02 


1.00 


1.07 


.88 


.72 


2 


. 182 


.67 


.74 


.58 


.56 


.51 


.35 


- >75 


- .78 


-1.30 


-1.87 


.71 


.67 


.59 




3 


183 


.49 


.27 


.73 


.63 


.76 


.66 


.03 


.03 


- .24 


- .27 


1.08 


.80 


1.18 


.88 


4 


184 


.34 


.28 


.45 


.42 


.48 


.45 


.90 


.96 


1.21 


1.29 


.50 


.46 


.55 


.50 


5 


185 


.61 


.76 


.56 


.56 


.60 


.52 


- .48 


- .47 


-1.18 


-1.37 


.67 


' .68 


.75 


.60 


6 


186 


.57 


.77 


.68 


.57 


.68 


.63 


- .26 


- .31 


-1.08 


-1.18 


.92 


.69 


.94 


.81 


7 


187 


.29 


.24 


.62 


.42 


.37 


.31 


.91 


1.33 


1.90 


2.31 


.78 


.46 


.40 


.32 


8 


188 


.55 


.68 


.75 


.63 


.77 


.7.1 


- .18 


- .22 


- .62 


- .67 


1.14 


.80 


1.22 


1.01 


9 


189 


.56 


.71 


.79 


.72 


.73 


.71 


- .21 


- .22 


- .78 


- .79 


1.27 


1.04 


1.06 


1.02 


10 


190 


.79 


.90 


.69 


.65 


.85 


.84 


-1.20 


-1.26 


-1.54 


-1.55 


.95 


.87 


1.59 


1.53 


11 


191 


.74 


.90 


.66 


.61 


.72 


.69 


- .99 


-1.08 


-1.76 


-1.85 


.87 


.76 


1.04 


.95 


12 


192 


.58 


.69 


.74 


.66 


.72 


.49 


- .29 


- .33 


- .71 


-1.03 


1.11 


.87 


1.03 


.57 



(continued) 



20 



GPO »S27— 034-4 



Table 7 (continued) 



Biserial 

Proportion Correlation X50 Beta 

Con- Correct Boys a Girlsb Bovs Girls Bovs Girls 

cept Task Item Boys Girls CTCTC T C TCTCl 



17 



O 

c 



18 



19 



c 

o 



ro 
N 

•r-l 
C 

fO 

o 



1 


193 


.72 


.79 


.57 


.49 


.69 


.66 


-1.03 


-1.20 


-1.15 


-1.19 


.70 


.56 


.94 


.89 


2 


194 


.77 


.83 


.69 


.68 


.58 


.JO 


- 1 07 


— 1 no 

— 1 . uo 


- 1 Ac; 

1 . D J 


1 Ac 


Q C 
. 7 3 


. V J 


.72 


.72 


3 


195 


.74 


.81 


. 59 


.63 


.80 


A7 

.Of 


- 1 OQ 


— 1 n 1 


- 1 no 
- 1 . u 0 


— 1 . 0 U 






1.34 


0 Q 
.07 


4 


196 


.82 


.88 


.72 


.60 


.78 


.73 


- 1 77 


1 . J J 


- 1 dQ 
1 7 


— 1 CQ 
- 1 . 3 V 


1 CiA 


. / 3 


1.^3 


1 n 7 


5 


197 


.42 


.41 


.48 


29 


.42 






7d 


. J ^ 


A7 


. 3 3 


. 3 0 


.46 


.3 5 


6 


198 


.59 


.72 


.85 


69 


.72 


. J*x 


7R 
. ^ 0 


— . J J 


— Q 1 

- . ol 


— 1 . Uo 


1 A/I 

i .o4 


.7? 


1. 04 


.63 


7 


199 


. 53 


.59 


.65 


. 55 


.65 


f, 1 


- 1 
. 1 J 


1 ^ 
. i J 


- . J 0 


1 Q 
.07 


Q C 
. 0 3 


.5 3 


0 L 

.86 


.78 


8 


200 


.75 


.8 5 


77 


7A 


.DO 


7 7 


- Q7 
. 0 » 


— Q Q 

— .00 


- 1 . 3 ( 


- i .4 3 


1.21 


1.17 


0 0 

.07 


1. 04 


9 


201 


.73 


.74 


.66 


. 5 5 


.64 


. J J 


- . 7 J 


1 . 1 J 


- 1 . U U 


— i . 


0 •? 
. 0 f 


.00 


.o4 


.62 


10 


202 


. 0 i. 


. 0 0 


.01 


. -3 0 


7R 


74 


— 1 n7 


1 dQ 




1 A 1 


I.Jo 


.71 


1.26 


1. 09 


11 


203 


.81 


.80 


.66 


.JO 


92 


If, 


1 . J J 


— 1 i; 1 

— i . J i 


- Q 7 

- .7^ 


— i . i i 


Q Q 
.07 


. / <1 


2.34 


1. lo 


12 


204 


. 50 


.67 


.63 


. 5 1 




.JO 


n 1 


n 1 


— Q 9 

- .0^ 


— i . 1 0 


Q n 
.oU 


.39 




.42 


1 


205 


.48 


.61 


.55 


.38 


.65 


.61 


.11 


.15 


- .42 


- .44 


.65 


.41 


.86 


.77 


2 


206 


.83 


.93 


.72 


.77 


.36 


.46 


- 1 n 

1 . J u 


— 1 7 1 


-rt. U 0 


— 7 1 A 


1 . U 3 


1.21 


.39 


. 52 


3 


207 


.56 


.70 


.66 


. 57 


. 53 


.46 




— 7R 


Q R 
- . 7 £5 


— 1 14 


Q 7 
. 0 f 


A Q 
.07 


. 0 5 


. 3^ 


4 


208 


.25 


.17 


.40 


.31 


.63 


.50 


1.72 


7 71' 


1 ^ 7 
1 . J ^ 


1 97 


dd 


. J J 


Q 1 
. 0 1 


C Q 
. JO 


5 


209 


.72 


.89 


.66 


.68 


.70 


.62 


.00 


- R R 


- 1 Id 


— 1 97 


Q7 
. 0 ( 


Q 7 
. 7 ^ 


Q 7 
. 7 r 


7 Q 
. i 0 


6 


210 


.64 


.69 


.75 


.66 


.71 


. 54 


- .48 


. J J 


7 1 


- 9*^ 
. / J 


1 1 4 


Q7 
. 0 I 


1 0 7 


A C 
. 0 3 


7 


21 1 


.47 


.49 


.48 


.50 


.46 


.3 5 


.18 


. 17 


. 06 


n7 


C4 
. 3*i 


C R 
. 3 0 


C 7 
. 3 ^ 


7 Q 
. DO 


'8 


212 


.69 


.81 


.80 


.72 


.77 


.79 


- .63 


- .70 


-1.13 


-1 09 


1 7 
1 . J ^ 


1 0 

1 . U J 


1 1 Q 


1 7 n 

1 . J U 


9 


213 


.81 


.86 


.64 


. 53 


.81 


.65 


-1.37 


-1.65 


-1.33 


-1 A4 


R4 

. Ort 


A 

. 0 J 


1 7 A 
1 . J 0 


Q A 
.00 


10 


214 


.77 


.90 


.72 


.62 


.68 


.71 


-1 . 04 


-1.22 


- 1 97 


- 1 R7 


1 n c 

1 . VJ 3 


7 9 


Q 7 
. 7^ 


1 07 


11 


215 


.70 


.11 


.76 


.57 


.64 


.62 


- " .68 


- 9 0 


- 1 1 
1 . 1 J 


-1.20 


1 1 A 
1.10 


7 n 


Q4 
. o4 


7 Q 
. i 0 


12 


216 


.45 


.59 


.63 


:5^ 


. 56 


.58 


.21 


. 23 


47 


- 40 


Q 7 
. 0 ^ 


7 7 
. ( J 


A Q 
.00 


7 1 


1 


217 


.75 


,91 


.61 


.47 


.96 


.62 


-1.12 


-1.46 


-1.42 


-2.21 


.77 


.53 


3.29 


.78 


2 


218 


.74 


.72 


.61 


.51 


.68 


.54 


-1.08 


-1.28 


- .85 


-1.08 


.77 


.60 


.93 


.64 


3 


219 


.71 


,83 


.66 


.60 


.79 


.65 


- .85 


- .94 


-1.18 


-1.45 


.89 


.75 


1.31 


.85 


4 


220 


.71 


.78 


.70 


.52 


.87 


.61 


- .80 


-1.07 


- .87 


-1.24 


.99 


.61 


1.77 


.77 


5' 


221 


.73 


.85 


.70 


.61 


.76 


.77 


- .87 


- .99 


-1.37 


-1.35 


.98 


.78 


1.18 


1.22 


6 


222 


.62 


.78 


.80 


.68 


.87 


.77 


- .38 


- .45 


- .89 ■ 


-1.01 


1.34 


.93 


1.76 


1.21 


7 


223 


.55 


.76 


.68 


.61 


.72 


.50' 


- .18 


- .20 


- .95 


-1.37 


.92 


.78 


1.05 


.88 


8 


224 


.79 


.93 


.65 


.58 


1.01 


.74 


-1.25 


-1.40 


.00 


-2.03 


.85 


.70 


.00 


1.10 


9 


225 


.75 


.89 


.80 


.77 


.66 


.52 


- .84 


- .87 


-1.84 


-2.33 


1,32 


1.21 


.88 


.61 


10 


226 


.72 


.84 


.62 


.56 


.72 


.66 


- .95 


-1.06 


-1.37 


-1.50 


.79 


.68 


1.03 


.87 


11 


227 


.80 


.85 


.80 


.70 


.69 


.68 


-1.05 


-1.21 


-1.52 


-1.53 


1.35 


.97 


.95 


.94 


12 


228 


.45 


.57 


.41 


.36 


.56 


.52 


.33 


.36 


- .32 


- .35 


.4 5 


.38 


.67 


.61 



20 



ro 



0 



1 


229 


.86 


.91 


.60 


.58 


.73 


.71 


-1.81 


-1.86 


-1. 


.87 


-1.93 


.75 


.72 


1.06 


2 


230 


.81 


.88 


.72 


.66 


.90 


.58 


-1.20 


-1.31 


-1. 


.30 


-2.01 


1.03 


.87 


2.01 


3. 


231 


.67 


.82 


.56 


.41 


.84 


.74 


- .77 


-1.05 


-1. 


.07 


-1.22 


.68 


.45 


1.55 


4 


232 


.72 


.82 


.69 


.62 


.58 


.67 


- .84 


- .93 


-1. 


.55 


-1.35 


.95 


.79 


.71 


5 


233 


..80 


.88 


.55 


.57 


.77 


.71 


-1.52 


-1.48 


-1. 


.50 


-1.65 


.66 


.69 


1.22 


6 


234 


.59 


.6 5 


.77 


.62 


.58 


.42 


- .29 


- .37 




.67 


- .94 


1.21 


.78 


.72 


7 


235 


.52 


.51 


.69 


.61 


.69 


.66 


- .08 


- .10 




.04 


- .04 


.95 


.76 


.94 


8 


236 


.66 


.78 


.62 


.62 


.72 


.58 


- .65 


- .65 


-1. 


.06 


-1.31 


.79 


.78 


1.03 


9 


237 


.82 


.92 


.67 


.62 


.74 


.74 


-1.37 


-1.48 


-1, 


,88 


-1.88 


.90 


.79 


1.11 


10 


238 


.70 


.78 


.69 


.57 


.78 


.81 


- .77 


- .94 




.97 


- .93 


.95 


.69 


1.26 


11 


239 


.78 


.84 


.59 


.63 


.64 


.59 


-1.31 


-1.22 


-1. 


.56 


-1.71 


.72 


.81 


.84 


12 


240 


.37 


.37 


.37 


.37 


.63 


.59 


.89 


.89 




.54 


.57 


.40 


.40 


.82 



1.00 
.71 

1.11 
.90 

1.00 
.46 
.88 
.71 

1.11 

1.40 
.73 
.74 



(continued) 



21 



I 



Table 7 (continued) 



Proportion 
Con- Correct 
cept Task Item Boys Girls 



21 



p 
o 
O 



22 



Q) 
O 
G 
(0 

m 

P 



23 



Q) 



(0 



24 



0) 

o 



Biserial 
Correlation 



B_QvsQ 
C T 



Girlsb 
C T 



Beta 



Boys 



Girls 



Boys 



Girls 



C 



1 


241 


.79 


.87 


.03 


.76 


|. 80 


.81 


-1.30 


-1 . 09 


- 1 .4 3 


-1.40 


.82 






1 Afi 
1 . *iU 


2 


242 


.85 


.89 


.56 


.55 


.71 


.58 


-1.83 


-1.86 


-1.72 


-2.08 


.67 


.66 


1.00 


-72 


3 


243 


.67 


.51 


.61 


.36 


.65 


.51 


- .70 


-1.21 


- .02 


- .03 


.78 


.38 


.85 


.59 


4 


244 


.53 


.49 


.83 


.77 


.67 


.60 


- .10 


- .11 


.04 


.04 


1.51 


1.22 


.VO 


.75 


5 


245 


.73 


.72 


.71 


.57 


.85 


.73 


- .56 


-1.06 


- .70 


- .82 


1.00 


.70 


1.61 


1.07 


6 


246 


.49 


.66 


.45 


.42 


.61 


.56 


.04 


.05 


- .69 


- .76 


.50 


.47 


.76 


.67 


7 


247 


.33 


.26 


.34 


.16 


.37 


.12 


1.29 


2.71 


1.75 


5.47 


.37 


.17 


.39 


.12 


8 


248 


.50 


.54 


.62 


.55 


.67 


.60 


- .01 


- .01 


- .13 


- .15 


.79 


.66 


.89 


.75 


9 


'249 


.58 


.72 


.67 


.53 


.66 


.72 


- .32 


- .40 


- .90 


- .83 


.90 


.62 


.88 


1.04 


10 


250 


.68 


.78 


.59 


.56 


.37 


.43 


- .81 


- .85 


-2.03 


-1.78 


.73 


.68 


.40 


.47 


1 1 


251 


.32 


.24 


.19 


.03 


.11 


-.05 


2.43 




6.02 




.19 


.03 


.12 


-.05 


12 


252 


.33 


.36 


.51 


.42 


.47 


.30 


.84 


1.02 


.78 


1.23 


.60 


.47 


. 53 


.31 


1 


253 


.82 




.73 


.67 


.77 


.66 


-1.23 


-1.35 


-1.55 


-1.80 


1.07 


.87 


1.19 


.88 


2 


254 


.76 


.89 


.72 


.62 


.71 


.68 


-1.00 


-1.17 


-1.71 


-1.78 


1.04 


.78 


1.01 


.93 


3 


255 


.70 


.88 


.63 


.62 


.93 


.93 


- .84 


- .85 


-1.24 


-1.25 


.82 


.80 


2.63 


2.52 


4 


256 


.75 


.88 


.74 


.56 


.61 


.57 


- .92 


-1.23 


-1.93 


-2.09 


1.11 


.67 


.78 


.69 


5 


257 


.76 


.82 


.71 


.73 


.72 


.71 


- .99 


- .96 


-1.26 


-1.26 


1.02 


A 

1.07 


1.03 


1.02 


6 


258 


.75 


.72 


.56 


.46 


.75 


.62 


-1.20 


-1.46 


- .79 


- .97 


.68 


.52 


1.15 


.78 


7 


259 


.44 


.55 


.54 


.57 


.67 


.63 


.30 


.28 


- .17 


- .18 


.65 


.69 


.90 


.82 


8 


260 


.76 


.84 


.60 


.56 


.72 


.60 


-1.18 


-1.26 


-1.39 


-1.68 


.74 


.67 


1.03 


.75 


9 


261 


.69 


.78 


.167 


.47 


.63 


.63 


- .88 


-1.07 


-1.21 


-1.19 


.70 


.53 


.81 


.82 


1 0 


262 


.64 


.76 


.61 


.60 


.73 


.61 


- .59 


- .60 


- .97 


-1.17 


.77 


.75 


1.05 


.76 


1 1 


263 


.58 


.68 


.55 


.47 


.60 


.36 


- .39 


- .46 


- .80 


-1.33 


.66 


.53 


.75 


.39 


12 


264 


.41 


.53 


.61 


.63 


.70 


.63 


.37 


.36 


- .11 


- .12 


.78 


.81 


.97 


.82 


1 


265 


.80 


.77 


.68 


.64 


.63 


.60 


-1.24 


-1.31 


-1.17 


-1.23 


.92 


. ot 


. O t. 


7 R 


2 


266 


.74 


.73 


.69 


.61 


.67 


.59 


- .92 


-1.05 


- .93 


-1.06 


.96 


.77 


.91 


.73 


3 


267 


.72 


.87 


.73 


.72 


.79 


.72 


- .79 


- .80 


-1.41 


-1.56 


1.08 


1.03 


1.30 


1.02 


4 


268 


.65 


.70 


.63 


.61 


.75 


.58 


- .52 


- .62 


- .72 


- .92 


1.06 


.76 


1.13 


.72 


5 


269 


.50 


.48 


.59 


.50 


.70 


.59 


.01 


.01 


.05 


.06 


.72 


.58 


.99 


.73 


6 


270 


.57 


.60 


.72 


.64 


.69 


.59 


- .24 


- .27 


- .37 


- .44 


1.05 


.83 


.96 


.73 


7 


271 


•35 


.45 


.61 


.65 


.54 


.44 


.61 


.58 


.24 


.29 


.78 


.85 


.65 


.49 


8 


272 


.65 


.74 


.65 


.62 


.77 


.58 


- .60 


- .63 


- .83 


-1.11 


.85 


.78 


1.21 


.71 


9 


273 


.54 


.63 


.41 


.28 


.68 


.58 


- .24 


- .35 


- .48 


- .56 


.45 


.29 


.92 


.72 


1 0 


274 


.53 


.63 


.68 


.58 


.68 


.65 


- .10 


- .12 


- .51 


- .52 


.93 


.73 


.92 


.85 


1 1 


275 


.56 


.71 


.66 


.62 


.79 


.62 


- .25 


- .26 


- .72 


- .91 


.87 


.80" 


1.28 


.80 


12 


276 


.60 


.69 


.76 


.67 


.72 


.60 


- .33 


- .38 


- .71 


- .84 


1.20 


.91 


1.03 


.75 


1 


277 


.89 


.86 


.58 


.56 


.73 


156 


-2. 10 


-2.16 


-1.46 


-1.91 


.71 


.68 


1.07 


.68 






.75 


.87 


.77 


.68 


.79 


.75 


- .89 


-1.01 


-1.45 


-1.53 


1.21 


.93 


1.28 


1.12 






.88 


.95 


.59 


.32 


.54 


.83 


-2.00 


-3.67 


-3.12 


-2.03 


.74 


.34' 


.64 


1.49 


'i- 


28'! 


.71 


.9^5 


.72 


.77 


.40 


.48 


-1.84 


-1.72 


-4.10 


-3.44 


1.04 


1.22 


.44 


.54 


5 


28: 


.79 


..Sb 


.70 


.72 


.72 


.52 


-1.1^ 


-1.13 


-1.50 


-2.08 


.97 


1.02 


1.05 


.61 


6 


Z^Z 


.76 


.84 


.59 


.46 


.74 


.54 


-1.1^ 


-1.53 


-1.36 


-1.86 


-.73 


.52 


1.09 


.64 


7 


283 


.73 


.91 


.73 


.61 


.44 


.48 


- .85 


-1.01 


-3.01 


-2.76 


1.08 


.78 


.49 


.55 


8 


284 


.78 


.88 


.86 


.77 


.78 


.70 


- .91 


-i.02 


-1.52 


-1.69 


1.72 


1.22 


1.24 


.99 


9 


285 


.74 


.86 


.54 


.61 


.67 


.48 


-1.22 


-1.07 


-1.63 


-2.28 


.63 


.77 


.90 


.55 


10 


286 


.86 


.96 


.74 


.57 


.89 


.74 


-1.47 


-1.92 


-1.95 


-2.34 


1.10 


.6-9 


1.97 


1.1 1 


11 


287 


.36 


.35 


.37 


.12 


.31 


.22 


.99 


2.91 


1.27 


1.75 


.39 


.13 


.33 


.23 


12 


288 


.35 


.43 


. .49 


.40 


.73 


.48 


.77 


.93 


.23 


.35 


.56 


.44 


1.06 


.55 
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Table 7 (continued) 



Proportion 
Con- Correct 
cept Task Item Boys Girls 



25 



CO 

c 
o 

iH 

(U 



2 



.26 



c 

0) 
0) 

a 
2 



27 



0) 

s 

CO 

a 

to 



28 



0) 

1 



3 



Blserlal 
Correlation 



Beta 



BoysQ 
C T 



Girlsb 
C T 



Boys 



Girls 



3ovs 



Girjs 



1 


289 


.74 


.8y 


.55 


.60 


.56 


.48 


-1.17 


-1.06 


-2.06 


-2.43 


.66 


.75 


.68 


. 54 


2 


290 


.50 


.54 


.45 


.29 


.43 


.30 


.01 


.02 


- .24 


- .34 


.50 


.30 


.48 


.31 


3 


291 


.72 


.85 


.66 


.60 


.65 


.53 


- .90 


- .98 


-1.57 


-1.92 


.88 


.76 


.86 


.63 


4 


292 


.83 


.94 


.60 


. 51 


.63 


.49 


-1.59 


-<1.89 


-2.51 


-3.25 


.76 


.59 


.82 


.56 


5 


293 


.81 


.84 


.45 


.56 


.70 


.65 


-1.91 


-1.54 


-1.45 


-1.57 


.51 


.67 


.99 


.86 


6 


294 


.29 


.24 


.50 


.28 


.53 


.27 


1.09 


1.92 


1.30 


2.51 


.58 


.30 


.63 


.29 


7 


295 


.29 


.15 


.30 


.16 


.50 


.41 


1.85 


3.62 


2.07 


2.52 


.32 


.16 


.57 


.44 


8 


296 


.52 


.69 


.60 


.61 


.67 


.68 


- .07 


- .07 


- .76 


- .75 


.76 


.76 


.90 


.92 


9 


297 


.27 


.31 


.42 


.26 


.63 


.26 


1.50 


2.40 


.81 


1.98 


.46 


.27 


.80 


.27 


10 


* 298 


.61 


.71 


.47 


.33 


.61 


.49 


- .60 


- .85 


- .92 


-1.17 


.53 


.35 


.79 


.56 


11 


299 


.52 


.61 


.54 


.48 


.52 


.36 


- .08 


- .09 


- .55 


- .80 


.64 


.55 


.61 


.38 


12 


300 


.40 


.42 


.55 


.41 


.64 


.47 


.46 


.62 


.30 


.41 


.66 


.45 


.84 


.54 


1 


301 


.70 


.87 


.58 


.57 


.70 


.75 


- .91 


- .94 


-1.62 


-1.51 


.72 


.69 


.99 


1. 14 


2 


3 02 


.68 


.73 


.52 


.48 


.63 


.63 


- .90 


- .98 


- .99 


-1.00 


.62 


.55 


.82 


.80 


3 


303 


.64 


.81 


.68 


.65 


.31 


.22 


- .51 


- .54 


-2.81 


-4.03 


.93 


.85 


.33 


.22 


4 


3 04 


.69 


.81 


.47 


.66 


.69 


.69 


-1.03 


- .74 


-1.27 


-1.28 


.54 


.89 


.97 


.95 


5 


305 


.54 


.54 


.65 


.59 


.60 


.40 


- .15 


- .16 


- .17 


- .26 


.85 


.73 


.76 


.44 


6 


306 


.32 


.32 


.52 


.50 


.52 


.32 


.91 


.95 


.92 


1.51 


.61 


.58 


.61 


.33 


7 


307 


.35 


.37 


.54 


.35 


.39 


.30 


.72 


1.11 


.84 


1.08 


.64 


.37 


.42 


.32 


8 


308 


.48 


.63 


.62 


.60 


.67 


.48 


.07 


.08 


- .50 


- .70 


.78 


.75 


.91 


.55 


9 


309 


.51 


.59 


.65 


.58 


.67 


.64 


- .05 


- .06 


- .33 


- .34 


.86 


.71 


.89 


.83 


10 


310 


.35 


.40 


.25 


.22 


.46 


.50 


1.49 


1.70 


.56 


.52 


.26 


.23 


.52 


.58 


11 


311 


.54 


.67 


.65 


.46 


.49 


.54 


- .17 


- .24 


- .93 


- .83 


.85 


.52 


.56 


.64 


12 


312 


.39 


.41 


.26 


.13 


.39 


.26 


1.02 


1.98 


.56 


-2.22 


.27 


.14 


.43 


.27 


1 


313 


.62 


.50 


.52 


.39 


.56 


.43 


- .59 


- .80 


.00 


. 00 


.62 


.42 


.68 


.48 


2 


314 


• 68 


!73 


.56 


t 


.65 


.72 


- .81 


- .67 


- .96 


- .87 


.68 


.95 


.86 


1.04 


3 


315 


.81 


.86 


.53 


.'57 


.66 


.60 


-1.63 


-1.50 


-1.63 


-1.79 


.62 


.70 


.87 


.74 


4 


316 


.75 


.88 


.62 


.57 


.55 


.57 


-1.11 


-1.20 


-2.11 


-2.03 


.79' 


.70 


.66 


.70 


5 


317- 


.69 


.82 


.57 


.50 


.75 


.73 


- .87 


-1.00 


-1.19 


-1.23 


.70 


.58 


1.15 


1.07 


6 


318 


.43 


.48 


. 52 


.41 


.51 


.44 


.36 


.46 


.10 


.12 


.60 


.45 


.59 


.48 


7 


319 


.43 


.40 


. 52 


.44 


.54 


.44 


.34 


.40 


.48 


.59 


.60 


.48 


.64 


.49 


8 


320 


.50 


.69 


.50 


.34 


.76 


.67 


- .01 


- .02 


- .65 


- .74 


.58 


.36 


1.16 


.90 


9 


321 


.46 


.67 


".53 


.47 


.61 


.67 


.18 


.21 


- .71 


- .65 


.63 


.53 


.77 


.91 


10 


322 


.40 


.48 


.56 


.49 


.49 


.47 


.45 


.51 


.08 


.08 


.68 


.57 ■ 


.56 


.53 


11 


323 


.64 


.65 


.63 


.48 


.48 


.33 


- .57 


- .75 


- .82 


-1.19 


.81 


.55 


.55 


.35 


12 


324 


.36 


.36 


.57 


. 58 


.68 


.63 


.63 


.62 


.52 


.56 


.69 


.71 


.93 


.82 


1 


325 


.87 


.91 


.67 


.74 


.55 


.65 


-1.67 


-1.51 


-2.46 


-2.08 


.89 


1.09 


.67 


.86 


2 


326 


.50 


.52 


.51 


.46 


.73 


.55 


,01 


.01 


- .07 


- .09 


.60 


.52 


1.08 


.66 


3 


327 


.67 


.67 


.58 


• 55 


.73 


.67 


- .74 


- .78 


- .62 


- .67 


.72 


.66 


1.06 


.91 


4 


328 


.79 


.80 


.70 


.65 


.88 


.63 


-1.17 


-1.27 


- .97 


-1.33 


-.98 


.86 


1.81 


.82 


5 




.6^ 




.57 


.53 


.88 


.75 


- .66 


- .71 


- .98 


-1.16 


.69 


.62 


1.85 


1.12 






. 4 ■„ 




.38 


.08 


.28 


.04 


.25 


1.16 


1.14 




.41 


.08 


.30 


.04 






.32 


.31 


.36 


.20 


.30 


.03 


1.30 


2.32 


1.67 




.39 


.21 


.31 


.03 




332 


.73 


.84 


.78 


.70 


.73 


.80 


- .80 


- .89 


-1.38 


-1.25 


1.25 


.98 


1.06 


1.33 


9 


333 


.55 


.72 


l75 


.72 


.81 


.72 


- .18 


- .19 


- .72 


- .81 


1.15 


1.04 


1.36 


1.03 


10 


334 


.55 


.69 


.67 


.62 


.73 


.67 


- .20 


- .22 


- .69 


- .76 


.91 


.79 


1.08 


.91 


11 


335 


.23 


.26 


.16 


.22 


.37 


.39 


4.70 


3.38 


1.72 


1.63 


.16 


.24 


.40 


.43 


12 


336 


.31 


.38 


.67 


.60 


.56 


.51 


.72 


.82 


.53 


.58 


.91 


.74 


.67 


.59 
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ible 7 (continued) 



Biserial 

Proportion Correlation X^o 



a 
to 

o 

Xi 
G 

CO 





Task 


Item 


Correct 


Bovs^ 


Girlsi3 


Bovs 




Girls 




Boys 


Girls 


C 


T 


C 


T 


C 


T 


C 


T 


■ 

C 




1 


337 


.75 


.90 


.68 


.79 


.59 


.64 


-i.qi - 


.87 


-2.15 


1- 

-1.98 


•- 


r 


2 


338 


.67 


.71 


.75 


.72 


.56 


.50 


- .59 - 


.62 


-l.OZ 


-1.13 






3 


339 


.56 


.53 


.63 


.50 


.70 


.64 


- .23 - 


.29 


- .i X 


.12 






4 


340 


.83 


.83 


.59 


.52 


.55 


.47 


-1.59 -1 


.81 


-1.71 


-2.00 . 




3 

•M 


5 


341 


.67 


.71 


.64 


.58 


.80 


.71 


- .70 - 


.77 




- .80 , 




(0 
Q) 


6 


342 


.51 


.63 


.75 


.69 


.64 


.59 


- .04 - 


.05 


- - j1 


- .5(' 1, 




Cm 


7 


343 


.31 




.56 


.55 






.90 


.92 








— « 
rD 

0 


8 


344 


.45 


.59 


.77 


.65 


.80 


.73 


.16 


.19 


- .29 


- .32 1, 






9 


345 


.47 


.51 


.67 


.62 


.65 


.54 


.11 


.11 


- .04 


- .05 . 




s: 


10 


346 


.41 


.47 


.55 


.40 


.66 


.44 


.41 


.57 


.12 


.17 






11 


347 


.35 


.37 


.43 


.31 


.67 


.57 


.90 1, 


.24 


.51 


.59 , 






12 


348 


.30 


.30 


.66 


.69 


.57 


.61 


.81 


.77 


.94 


.88 


..S8 



N = 195 
'^N = 196 



Qlr\s 



.73 .• 
• 7 . ■ • 

.•6 .53 

1.31 1.00 
..^2 .72 

..34 l.?M 

.S7 .4^^ 
.90 .70 
.h9 -.78 



1 


349 


.88 


.91 


.70 


.82 


.56 


.78 


-1.68 


-1.45 


-2.44 


-1.74 




1.41 


.67 


I. .25 


2 


350 


.73 


.80 


.64 


.50 


.78 


.71 


- .95 


-1.20 


-1.06 


-1.16 




.59 


1.25 


l.il 


3 


351 


.78 


.90 


.71 


.71 


.60 


.57 


-1.12 


-1.11 


-2.16 


-2.29 


1. 0(" 


1.00 


.75 


9 


4 


352 


.75 


.83 


.62 


.55 


.67 


.42 


-1.09 


-1.21 


-1.41 


-2.23 




.66 


.90 


.47 


5 


353 


.72 


.90 


.75 


.74 


.78 


.76 


- -76 


- .78 


-1.66 


-:1.70 


1.15 


1.11 


1.26 


l.i.8 


6 


354 


.43 


.60 


.44 


.39 


.39 


.29 


.43 


.48 


- .62 


- .85 


-49 


.42 


.43 


.50 


7 


355 


.44 


.39 


.47 


.41 


.56 


.53 


.32 


.36 


.48 


.51 


- "53 


.45 


.68 


.t 3 


8 


356 


.46 


.64 


.62 


.59 


.^■•9 


.55 


.16 


.16 


- .51 


- .64 




.72 


.94 


.( ') 


9 


357 


.67 


.85 


.65 


.61 


.70 


.49 


- .66 


- .70 


-1.47 


-2.10 


Hi. 


.77 


.97 




10 


358 


.35 


.30 


.36 


.32 


.49 


.37 


1.09 


1.22 


1.06 


1.40 


. il8 


.34 


.56 


.40 


11 


359 


.51 


.72 


.-74 


.63 


.70 


.67 


- .03 


- .03 


- .85 


- .89 


1..0 


.82 


.98 


.9C 


12 


360 


.33 


.32 


.59 


.46 


.58 


.44 


.76 


.96 


.80 


1.06 




.52 


.71 


.49 



correlation for these two cases was greater 
than 1.00, and the X50 and (3 could not be 
computed. The (3 for these items can be in- 
terpreted as being infinity. 

If desired, the items that make up a cri- 
terion score can be separated out. This is 
easy to do for a concept; the items composing 
the criterion score are simply the 12 given in 
order consisting of one of each task type. 
For ^xample, the items composing the criterion 
score for Concept 3 are numbered 25 through 
36. The items composing the criterion score 
for a task are those with the same task num- 
ber for each of the concepts; for example, the 
items composing the criterion score for Task 1 
are numbered 1, 13, 25, 37, etc., with the last 
one±)eing number 349. • 

lAs was evident from the means of the total 
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scores, and as can be seen from the two diff- 
culty indices given for the items (proportion 
correct and X50), ttie items, in general, were 
more difficult for the boys than iaz the giris. 
There is not a one-to-one corresr.'iDndence for 
each item, however; there are some exceptiom^, 
since some items were more difficult for the 
girls and some were about the s.acr^e. As was 
pointed out earlier, however, nn conclusions 
can be drawn from this becausertte data for 
the girls were collected; In fmjm^sxmmer 
shortly after the end. ofithe^frfE^":iifrade schoo.: 
year and data ics-rthe boys wece collected 
in the fa, shortly sBser their sisltlK |?;i^lde schcEa 
year had begun. Tlio.diifi^-icult^? omdicos ob- 
tained indicate that thB-BB items are of ap- 
propriate difficulty levels for ^pse subjects- 
It seems.clear from lookir|| af^.able 7 
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that Xsc 1 ives more precise in-iormation ; ^^ 
the d if fit J..t;vr level ; an iteir '.vhen that , 
item is a . j-rr- 'A • of two criterion sc . 
I The propori.trr corr-nr- remains the same z" 
both of the cruerk ; rores. This index ' 
how many su^/Hct;" . ponded zo the cc-- ' 
ansv/er for an iiS:.:.-. out it says nothing a;. , .: 
their ability J.-^:: as measured by a partic r 
criterion sccirfj — total concept score or tc 
task score in this case. The item d iff icu ■ 
index, X^o* gives {in standard deviation. urr* 
the criterion srrs^ at which a subject wou. 
have a rhaxirce of getting the item car 

rect. For^snrpls.,. an X^o vakie of 1,20 fc- n 
Item indicensz: thai subjects ^/ith a criterisv 
score 1 .21(0 irnirrrd deviation units abovi 
mean hars7e-ci."5~i''v. chance of answering tha_ 
item correczl^.. Subjects with a criterion 
score higherrniaTi this would have a greate.: 
chance of asssr^/ering that item correctly, ar.d 
subjects witih a criterion score louver than^ 
this would htive a lesser chance. Likewis.^, 
an X50 value of -l^ZO means that subjects -.vith 
a criterion score 1 .20 standard deviations 
below the mean would have a 50% chance of 
getting that item correct; for a higher score 
the chance would be greater, and for a lower 
score the chance wGuld be less. Knowing 
both X50 and (3 for ar item allows one to readily 
determine the prob vility of answering an item 
correctly for any point on the criterion scale 
(Baker, 1964). It may be pointed out that when 
P = .50, X50 = .00; when P is greater than .50 
then X50 will be negative and, for a certain P, 
the higher the (3 value the closer to zero will 
be the X50 value. This can be seen from in- 
specting Table 7. For example, for Item 1 the 
P is higher for the concept score than it is 
for the task score for both boys and girls; 
similarly for both boys and girls, the X50 value 
is closer to zero for the concept score than it 
is for the task score. For P less than ,50, the 
X50 will be positive, and again, for a certain 
P, the higher the (3 value the closer to zero 
will be the X50 value. See Item 347 for an 
illustration of this. 

The two item discrimination indices. .bi- 
serial correlation and p, ar^ more closely re- 
lated since p is cnmputed as a functimn of 
the biserial corretetion (Baker, 1969). Tiiey 
are not linearly refeted, however. Yvom ,00 
to about .30 (absDtete) they are very rseairly 
the same; beyond thntE. p begins to incf<?vase 
quite rapidly in ma:?nit,udc^ ^ ^tmay be ;rj.. ated 

^ tha t p i s a 1 wa ys. . esi M.fi- [ ^ ■ '^vr .;;srj^:*^i>!^r ,31 - 
iio te) than the bisenciii cc itdoij. /<•':•. 
general rul^, ^30 is oitma used as a lower 
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cur:i;ii):: point fc: a lies:;; ;;;IC' biserial correla- 
ticn cr 3. For a izz^l s .cr-: composed of 
relBtirrely few itier:.s, as : the concept score, 
a mucr, higher n-. :niniurTi :v;uuld be desirable. 

Aj5 can be senn fro— Table 7, almost all 
of the social stuci^es iter: have desirable 
biseri:!;! correlations and :5 when the item is 
bc::h 3 part of a concept c-.terion score and 
a v^sik criten ion sccre, an .. most of them are 
■:^~r good, Ihe it.c_si obv^.vous thing is that 
t-T.v i^s are higher, with :t. ::~rw exceptions, 
v*T;.-:inl:he item :s a part en 3 concept criterion 
sc.::re than when it is a ...ar: of a|task criterion 
snare.. This is to be e>rpe<cted since the con- 
cept score consists of considerably fewer 
items than does the task j-~core — 1.Z items for 
most concept scores anc. i :) items tor most 
task scores- The item-crit-3rion biserial cor- 
relation is a part-whole correlation, with the 
criterion the total score 01 which the item, is 
a part, and the fewer the number of items the 
greater should be the correlation of that item 
with the total score of which it is a part. 
Since p is computed as a function of the bi- 
serial correlation, it is affected in the sarae 
manner. There does not seem to be a con- 
sistent pattern in the magnitude of the ps for 
the boys as compared with the girls. For 
some of the items, the ps are considerably 
higher for the boys, and for some of them they 
are considerably higher for the girls. For the 
tryouts of the items, data for both boys and 
girls were analyzed together. If the data for 
boys and girls were pooled and item analyzed, 
the p values would probably increase for most 
of the items . 

As was discussed earlier, these item in- 
dices were obtained by performing conven- 
tional item analyses on two different types 
of scores — one for concept criterion scores 
and one for task criterion scores. This was 
necessitated by the lack of item analysis 
procedures appropriate for use with data col- 
lected using a completely crossed design to 
build the items. It is not known how the item 
indices would be affected if procedures were 
available to compute them simultaneously 
ta?.:ing into account the effects of the crossed 
design. A gu^|:s would be that discrimination 
indices would%e affected more than would 
difficulty indices, if there were an effect. It 
it plausible to expect that there may be some 
concept- task interactions which cannot be, 
at least readily, ascertained by doing k con- 
ventional item analysis on the two types of 
scjares. 

I 
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and ^CZonclusuDns 



of the project en- 

AttainiTiGnt /-oil- 
r more made Is or 
r:7nent abilities, 
eincy witr aciual 
:/s for at&inLig 
'^rken to the 



'rr primary c^.'^iictr-'- 

-^c --Structure :ICl...... 

1, . to formuiatie cr^-a 
sr : 1 'Gs of concepx ar:~: 
•r-.: .-^ -assess their -onr 
-ui^z^ -Dne of the innjor ::: : 
' mary object .T^e vns. 
■r^r^z .;nment of te SITS -to Tne- -rare achievement 
a ^-d^rzted Mnguaoe arts, ,::':naLhennati:cs, 
'.Sv:' "ice., and social studies croncept:^ appro- 
l3rjLite dz the fourth grade le^'^Hl. Thin paper 
*>iciscr;vljes the test developntent effocis and 
■■-Si^rrs the item and total. ^ore stattsxrcs 

nvnedl :using the frevised Items devaioEed 
-■^sb nasas'iining achtevement of seleclsrd con- 
CT'pts in social studies. 

S,uibject matter specialists identified 
strj-:.^2' compounE'word class if icatcry con- 
oepiE :fcKr three msjor areas , and randomly 
5.^s:3ed 10 from each area to be studied. 
Thiese. 3(0 selected concepts were then aea- 
^y>ze.d. Twelve items for each concept were 
:.i2Sveioped; one for each of the first 12 tasks 
x!c ^4v Schema for Testing the Level of Concept 
M^;s-2ery" (Frayer, Firedrick., & Klausmeier, 
1969').. 

Tfe items that -were, developed v-e^er ad- 
232.iTiiJi'tered during early summer of 1 - 70 to 
V^(y r^nris. who had justz^ainpleted the fifth 
girade anii during the fall of 1970 to I •.•6:. boys 
Avmo hamt just begimii the Hiicth grade . These 
dfeta wsffls item ana lyzen.^.se para teiy for boys, 

Itnr -girls, using thejSTAP program fBaker* 

Ifee^ means r st^nda^r, ieviatioas,, and Hoyt 
f<^4i»Illty estimates obta^i^med are pre.se nted 
^imi discussed for .total o^teept airi.:tGd:al task 

SBOTraKi-. Four different Itean indices ^iropor- 

ttioci ecarrect, item-criterican bisecia. cor; ^ la- 
r^om., Xn^., and (3 — o-btaiae^J^ for .^ch 'ter; based 



on - "■.rn of two criter:.:jn scor apr^iiinDpriate 
tor concept score and ap.pr:;.. ^riate ratal task 
sc are presented snnldisc. .ssed- 



Cru iiflsioris 

The major conclusiisans drr-'wn are: 

1, The reliability esti-nates obtained 
for both total concept scores and 
total task scoreis are smiificiently 
high to warrant stuiiy at tke dimen- 
sionality of these seiected social 
studies concepts and the dimen- 
sionality of the tasks wheni using 
social studies content. 

2.. lEhe three area distinctions seem not 
be importaicEt ones. 

3. The difficulty item incices obtained 
imdicate that these items are of 
appropriate difficulty Levels for 
tEaese subjects. 

4. Almost all of the itenrs :have desirable 
levels of discriminataxin indices when 
the item is both a part of a concept 
criterion score and a task criterion 
score.. 



Recotmn^idation; 

The completEjly cros.sed design used to 
constrmct these achieveinent tests is a very 
interesting one. This type of design might 
well be used moBS often iatdthe^ future. It would 
be highiLy desiraibie to have ,ais^ilable Item 
analysis oiijo.cedures that aiFe s^ipropriate.for 
analyzinc? siach crossed desigitts. At the present 
such a metfiodoiogy ii£ not 'kasa^^n. 
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Appfanfo J4 

Key for Conceptj^ in l^binKxical Order 



1 CCTsilinp 

2 Deita 

3 Deesert 

4 Gulf 

6 Ri^er 

7 Ri-zer M:o.::ith 

8 Strait 

9 Tributary 

1 0 Tropical. ■Rec:a0i]n 

1 1 Airway 

12 City 

13 CauntrysSde 

14 DeTnocrc^'"7 

15 Exchant^-: 

16 GovGrr. " y^sri. 

17 Land r:.o\xa^ 

18 News 

1 9 Orci'»jir Biior. 
20 

21 Counr-ry 

22 DistaacG 

23 East- Vest Lxms of Latitude 

24 Glob^ 

2 5 Map l^irectiOTT;? 

26 Map *^easurerr-^rnt 

27 Map 5cQie 

28 North-South JL.iristrS. of Longitu:::ce 
2^ Physicsd' ."taTZurf- M'bv 

3>0 SymbcDl 5^I::ap 
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